-- Logs begin at Wed 2022-07-06 16:05:18 UTC, end at Wed 2022-07-06 17:30:34 UTC. -- Jul 06 16:55:55.872377 dv-cinder-806605-6-smb systemd[1]: Starting Devstack devstack@keystone.service... Jul 06 16:55:55.879766 dv-cinder-806605-6-smb devstack@keystone.service[80618]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Jul 06 16:55:55.881801 dv-cinder-806605-6-smb devstack@keystone.service[80618]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed Jul 6 16:55:55 2022] *** Jul 06 16:55:55.881801 dv-cinder-806605-6-smb devstack@keystone.service[80618]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jul 06 16:55:55.881801 dv-cinder-806605-6-smb devstack@keystone.service[80618]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jul 06 16:55:55.881801 dv-cinder-806605-6-smb devstack@keystone.service[80618]: nodename: dv-cinder-806605-6-smb Jul 06 16:55:55.881801 dv-cinder-806605-6-smb devstack@keystone.service[80618]: machine: x86_64 Jul 06 16:55:55.881801 dv-cinder-806605-6-smb devstack@keystone.service[80618]: clock source: unix Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: pcre jit disabled Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: detected number of CPU cores: 4 Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: current working directory: / Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: detected binary path: /usr/bin/uwsgi-core Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: your processes number limit is 47680 Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: your memory page size is 4096 bytes Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: detected max file descriptor number: 2048 Jul 06 16:55:55.882478 dv-cinder-806605-6-smb devstack@keystone.service[80618]: lock engine: pthread robust mutexes Jul 06 16:55:55.886358 dv-cinder-806605-6-smb devstack@keystone.service[80618]: thunder lock: enabled Jul 06 16:55:55.886358 dv-cinder-806605-6-smb devstack@keystone.service[80618]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Jul 06 16:55:55.886358 dv-cinder-806605-6-smb devstack@keystone.service[80618]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jul 06 16:55:55.927902 dv-cinder-806605-6-smb devstack@keystone.service[80618]: Python main interpreter initialized at 0x55f3b14fc9c0 Jul 06 16:55:55.927902 dv-cinder-806605-6-smb devstack@keystone.service[80618]: python threads support enabled Jul 06 16:55:55.927902 dv-cinder-806605-6-smb devstack@keystone.service[80618]: your server socket listen backlog is limited to 100 connections Jul 06 16:55:55.927902 dv-cinder-806605-6-smb devstack@keystone.service[80618]: your mercy for graceful operations on workers is 90 seconds Jul 06 16:55:55.928274 dv-cinder-806605-6-smb devstack@keystone.service[80618]: mapped 403077 bytes (393 KB) for 2 cores Jul 06 16:55:55.928349 dv-cinder-806605-6-smb devstack@keystone.service[80618]: *** Operational MODE: preforking *** Jul 06 16:55:55.928595 dv-cinder-806605-6-smb devstack@keystone.service[80618]: *** uWSGI is running in multiple interpreter mode *** Jul 06 16:55:55.928595 dv-cinder-806605-6-smb devstack@keystone.service[80618]: spawned uWSGI master process (pid: 80618) Jul 06 16:55:55.928797 dv-cinder-806605-6-smb systemd[1]: Started Devstack devstack@keystone.service. Jul 06 16:55:55.929952 dv-cinder-806605-6-smb devstack@keystone.service[80618]: spawned uWSGI worker 1 (pid: 80631, cores: 1) Jul 06 16:55:55.929952 dv-cinder-806605-6-smb devstack@keystone.service[80618]: spawned uWSGI worker 2 (pid: 80632, cores: 1) Jul 06 16:55:55.929952 dv-cinder-806605-6-smb devstack@keystone.service[80618]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jul 06 16:56:01.382417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 16:56:01.382417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: from cryptography.utils import int_from_bytes Jul 06 16:56:01.383219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 16:56:01.383219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: from cryptography.utils import int_from_bytes Jul 06 16:56:01.383374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 16:56:01.383374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: from cryptography.utils import int_from_bytes Jul 06 16:56:01.383887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jul 06 16:56:01.383887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: from cryptography.utils import int_from_bytes Jul 06 16:56:01.431656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 16:56:01.431860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 16:56:01.432052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] command line args: [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 16:56:01.432245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jul 06 16:56:01.432332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 16:56:01.432454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jul 06 16:56:01.432543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ================================================================================ {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 16:56:01.432655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] command line args: [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jul 06 16:56:01.432790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] admin_token = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.432930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jul 06 16:56:01.433028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] config_dir = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ================================================================================ {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jul 06 16:56:01.433181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] config_source = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] admin_token = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] debug = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] config_dir = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.433984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] config_source = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] debug = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.434997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_config_append = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_dir = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_file = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_config_append = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.435928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_dir = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_file = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.436888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437121 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.437968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.438976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] publish_errors = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.439979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.20/identity {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] publish_errors = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.440979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] standard_threads = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] standard_threads = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] use_journal = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.441987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] use_json = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] use_stderr = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] use_syslog = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] use_journal = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] use_json = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442693 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] use_stderr = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.442843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] use_syslog = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.442984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jul 06 16:56:01.443247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.443963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.444922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.445947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.446934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.447899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.448980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.449904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.450870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.451960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.452980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.453859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.454946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.455979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.456906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.457999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.458957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459042 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.459985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.460908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.461998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462489 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.462962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.463976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.464904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.465973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.466943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.external = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.external = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.467965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.password = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] auth.token = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.468999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.password = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] auth.token = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.469909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.470888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.471463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.471662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.471740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.471892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.471972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.472933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.473986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.474931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.475871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.476994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477226 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.477942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.478995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.479914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.480982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.481961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.482996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483385 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.483919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.484852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.485943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.486039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.486192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.486272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.486426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.486505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.486703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.487313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.487463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.487542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.487696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.487782 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.487931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.488946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.489878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.490976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.491922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.492922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.493849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.494974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.495981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496226 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.496985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.497995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.498945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.499968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.500917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] role.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] role.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.501862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] role.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] role.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502607 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.502839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.503959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.504994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.505161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.505297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.505405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.505529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.505774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.505853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.506836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.507953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.508956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.509888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.510844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.511946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.512956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.513886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.connection = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.514907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.connection = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.515979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.516982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.517930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.518731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80631) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 16:56:01.518806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.519030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jul 06 16:56:01.519201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80632) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jul 06 16:56:01.549967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.550221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.550439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.550603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.551348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.551348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.558797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.559419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.586543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.586770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.587304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.587541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.729095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.729680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.777622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.777849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.778747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.778989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.841395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.841623 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.841846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.841992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.842956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.843176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.867188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.867416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.867514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.867640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.867780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.867862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.868878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.879947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.880376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.893515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.893687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.893795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.893918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80631) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.894871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.895001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80632) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Jul 06 16:56:01.912432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.912643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 16:56:01.912977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.913177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 16:56:01.913447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.913530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.913674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 16:56:01.913752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.913940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.914022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.914190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Jul 06 16:56:01.914273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.914464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.914842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.915103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.915361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.925025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.925299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.925562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.925833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.926406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.926681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.926947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.927225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.934203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.935565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.937465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.937743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.938019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.938387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.938667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.938860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.938943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.939987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.940066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.940244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.940333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.940509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.940780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.941049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.941317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.941579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.967158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.968644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.968763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.969041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.970346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.970625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.974852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.975129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.975518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.976452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.976730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.977126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.982845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.983085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.984418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.984695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.988090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.988371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.988648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.988925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.989198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.989468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.989697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:01.989779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.989975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.990075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.990279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.990561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.990836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.991109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.991376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:01.991644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.009489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.009765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.011199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.011475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.014382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.016065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.018021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.018332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.019729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.020021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.023435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.025148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.027052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.028809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.030693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.030988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.031276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.031567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.031846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.032118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.032457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.032753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.033035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.033311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.033636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.033915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.051649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.051927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.052193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.052490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.053581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.053864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.054161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.054425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.060318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.062050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.062322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.062404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.064026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.064299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.066015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.066308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.066583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.066858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.067149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.068044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.068322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.068608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.068884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.069165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.080402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.080676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.080951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.081226 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.081500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.082561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.082838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.083031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.083113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.083327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.083409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.083636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.085156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.085453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.101746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.103898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.105015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.107184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.108311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.110055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.110515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.112214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.112498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.112774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.112856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.114448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.114726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.115011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.120094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.121692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.122358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.123970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.124933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.125218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.125607 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.125882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.127245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.127535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.127922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.128198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.135297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.135578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.135853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.137566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.137851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.138152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.143731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80631) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.144006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.144281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.144551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.144815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.145180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.145458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.145728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.145993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.146093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80632) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Jul 06 16:56:02.146290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.146372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.146561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.146643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.146818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.146898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.147084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.147171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.147342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80631) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.147465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.147741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.148015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.148286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.148554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.148829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.149095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.149359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.149621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80632) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Jul 06 16:56:02.185896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f3b14fc9c0 pid: 80631 (default app) Jul 06 16:56:02.188372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WSGI app 0 (mountpoint='') ready in 7 seconds on interpreter 0x55f3b14fc9c0 pid: 80632 (default app) Jul 06 16:56:02.189218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420bdc-ecbf-48fe-b570-ec1f69da6ddd None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:02.189506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420bdc-ecbf-48fe-b570-ec1f69da6ddd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:02.189831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1420bdc-ecbf-48fe-b570-ec1f69da6ddd None None] PATH_INFO: `/v3` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:02.193977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1/1] 10.222.0.20 () {50 vars in 791 bytes} [Wed Jul 6 16:56:02 2022] GET /identity/v3/ => generated 255 bytes in 7 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:10.597188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:10.597698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:10.597790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:10.602041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1/2] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:10 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:10.607093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:10.607468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:10.607652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:10.675741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: INFO dbcounter [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] Registered counter for database keystone Jul 06 16:56:10.696749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG oslo_db.sqlalchemy.engines [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80631) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 16:56:10.702824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writer thread running {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 16:56:10.879301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG passlib.handlers.bcrypt [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80631) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 16:56:10.879750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG passlib.handlers.bcrypt [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80631) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 16:56:10.933624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:10.935259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:11.055487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 2/3] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:10 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 449 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 16:56:11.220937 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:11.290818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: INFO dbcounter [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] Registered counter for database keystone Jul 06 16:56:11.310373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG oslo_db.sqlalchemy.engines [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80632) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jul 06 16:56:11.316565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writer thread running {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jul 06 16:56:11.435406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df97e70-86df-46eb-a56e-03f23ea33c48 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:11.439666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:11.440349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:11.440635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:11.440914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:11.448916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:11.499983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 16:56:11.500274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f301ddcd-6522-4e54-b4df-3fd6b431010d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:11.509913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 2/4] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Jul 6 16:56:11 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 16:56:11.515942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:11.530840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45aea50-704b-47c3-9873-f4aa03217db5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:11.535960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:11.537094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:11.537383 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:11.537664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] PATH_INFO: `/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:11.539199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] RBAC: Authorizing `identity:get_project(project_id=e4521befd6aa4cfbb3b9af1101181f7f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:11.591572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING keystone.common.rbac_enforcer.enforcer [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Jul 06 16:56:11.591920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-256eb5b8-8735-4f54-82d3-5f91837ee34b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:11.597145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 3/5] 10.222.0.20 () {56 vars in 1207 bytes} [Wed Jul 6 16:56:11 2022] GET /identity/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:13.610534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bb275-4836-4c6f-ad78-89e1286f0ed4 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:13.611006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bb275-4836-4c6f-ad78-89e1286f0ed4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:13.611105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070bb275-4836-4c6f-ad78-89e1286f0ed4 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:13.615785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 3/6] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:13 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:13.621161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:13.621563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:13.621730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:13.640451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:13.641968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:13.649839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 4/7] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:13 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Jul 06 16:56:13.671988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bb275-4836-4c6f-ad78-89e1286f0ed4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:13.684452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070bb275-4836-4c6f-ad78-89e1286f0ed4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:13.688607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d935f-932b-4d24-9593-ab8b0bcde8d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:13.689225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d935f-932b-4d24-9593-ab8b0bcde8d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:13.689506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d935f-932b-4d24-9593-ab8b0bcde8d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:13.689781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d935f-932b-4d24-9593-ab8b0bcde8d4 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:13.697402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d935f-932b-4d24-9593-ab8b0bcde8d4 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:13.699198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d935f-932b-4d24-9593-ab8b0bcde8d4 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:13.708379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 4/8] 10.222.0.20 () {58 vars in 1324 bytes} [Wed Jul 6 16:56:13 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 16:56:13.713346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:13.722868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda2a108-049a-4e6d-8ec3-bbc7983a5752 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:13.732729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9dde9cc-1f28-4fc2-aede-7d3687beed90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:13.732729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde9cc-1f28-4fc2-aede-7d3687beed90 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:13.732729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde9cc-1f28-4fc2-aede-7d3687beed90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:13.732729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9dde9cc-1f28-4fc2-aede-7d3687beed90 admin admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:13.733056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde9cc-1f28-4fc2-aede-7d3687beed90 admin admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:13.733056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9dde9cc-1f28-4fc2-aede-7d3687beed90 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:13.733413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 5/9] 10.222.0.20 () {56 vars in 1198 bytes} [Wed Jul 6 16:56:13 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:15.798943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037acad2-4802-4737-bd98-62a159e8a9c4 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:15.799447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037acad2-4802-4737-bd98-62a159e8a9c4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:15.799538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-037acad2-4802-4737-bd98-62a159e8a9c4 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:15.801499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 5/10] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:15.806637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:15.807063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:15.807204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:15.810294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8220-41bb-41c9-b6e6-325a8e7be93f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:15.810588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8220-41bb-41c9-b6e6-325a8e7be93f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:15.810871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50de8220-41bb-41c9-b6e6-325a8e7be93f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:15.812117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 6/11] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:15.817088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:15.817378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:15.817656 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:15.824627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:15.825812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:15.856402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG passlib.handlers.bcrypt [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80632) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Jul 06 16:56:15.856821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG passlib.handlers.bcrypt [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80632) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Jul 06 16:56:15.902523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:15.904087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:15.905303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 6/12] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:15.929273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:15.952698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.003737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 7/13] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:16.026158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.034708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f7a3771-5a7d-4c3d-8e57-b7e2388cbaa0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.067755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.068550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.068832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.069116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.080162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:16.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:16.092933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:16.093949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 7/14] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:15 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:16.099318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.128688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28013190-7f69-4a11-80bf-5d51a72bf0f2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.130958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.168660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.169558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.169847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.170167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.180674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.198296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8618e97f-4c5e-4066-8452-abffd964d4b7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.233198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595927-63af-4910-9834-387be5587a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.233862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595927-63af-4910-9834-387be5587a42 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.234197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595927-63af-4910-9834-387be5587a42 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.234502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22595927-63af-4910-9834-387be5587a42 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.235262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595927-63af-4910-9834-387be5587a42 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:16.235576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595927-63af-4910-9834-387be5587a42 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.236467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.237007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22595927-63af-4910-9834-387be5587a42 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.238050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.248673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 8/15] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:16.254310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595927-63af-4910-9834-387be5587a42 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.341957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 8/16] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:56:16.342890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.345479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.355628 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22595927-63af-4910-9834-387be5587a42 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.389171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.390053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.390351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.390622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.391806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.393836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.395661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 9/17] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:16.400657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.414602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.439829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e96cb4-9d95-4104-b8e8-ceed3ebb7c5b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.473226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.474011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.474333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.474618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.492823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.494329 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.496953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7b7c1d4-b276-4724-b8a4-7482b94d0cbf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:56:16.517610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:16.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:16.519905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:56:16.519905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:56:16.519905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:56:16.519905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:16.519905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 9/18] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:16.525039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.532959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.532959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.532959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.532959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.534594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.536078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.537752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 10/19] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:16.543242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:16.581915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.623398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:16.624790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c512dd89-556e-4cfa-a73d-a667cef428aa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.642310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b091b18d-7360-45cb-9532-0ced0277ccee None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:16.658648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.659348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.659630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.659912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.660641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:16.660948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.662368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-195da78f-227b-4ca6-addc-4e63efa7d988 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.677391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:16.678061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:16.678359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:16.678644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:16.679480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.domain.id=default, user.id=861320b46d7645f3b4d8d49005174ddc) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:16.680098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:16.680206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 10/20] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:16.681248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abab371d-8547-471a-9957-3ede4eaa6ffc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:16.688474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 11/21] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Jul 6 16:56:16 2022] GET /identity/v3/role_assignments?user.id=861320b46d7645f3b4d8d49005174ddc&scope.domain.id=default&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 233 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:18.960161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6cdf-6dc9-41e0-bcb4-771241e649ad None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:18.960688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6cdf-6dc9-41e0-bcb4-771241e649ad None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:18.960688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebff6cdf-6dc9-41e0-bcb4-771241e649ad None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:18.962472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 11/22] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:18.967835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97f2b-0dce-409e-8a00-304a93ca82ae None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:18.968265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97f2b-0dce-409e-8a00-304a93ca82ae None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:18.974498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb97f2b-0dce-409e-8a00-304a93ca82ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:18.995202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0cb97f2b-0dce-409e-8a00-304a93ca82ae None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:18.996422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0cb97f2b-0dce-409e-8a00-304a93ca82ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:19.084751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 12/23] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:19.131461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6cdf-6dc9-41e0-bcb4-771241e649ad None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:19.145833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e150a7-2a66-4cd9-a463-13af0ad66b70 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.146152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e150a7-2a66-4cd9-a463-13af0ad66b70 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.146436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9e150a7-2a66-4cd9-a463-13af0ad66b70 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.148227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 13/24] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:19.167771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.168058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.168496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.199142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:19.200568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:19.339687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebff6cdf-6dc9-41e0-bcb4-771241e649ad None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:19.342522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 14/25] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:19.373666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:19.382106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:19.387922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:19.402494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:19.403348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.403639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.403924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.424015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:19.426229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:56:19.455624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:19.456476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:19.457707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:56:19.457707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:56:19.457707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:56:19.457707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:19.457707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 12/26] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 326 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:19.464093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:19.555317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c092c5-9d46-4818-bd02-09a88158d292 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:19.602600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ff47402-4748-439f-96d3-ca5b00f5df31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:19.603981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff47402-4748-439f-96d3-ca5b00f5df31 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.604485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff47402-4748-439f-96d3-ca5b00f5df31 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.604858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ff47402-4748-439f-96d3-ca5b00f5df31 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.606737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abbcf221-d7e1-4d65-8a90-6976a9bed76b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:19.618173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ff47402-4748-439f-96d3-ca5b00f5df31 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-2ff47402-4748-439f-96d3-ca5b00f5df31 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:19.627916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:19.628782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:19.629528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:19.631547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 15/27] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:19.634053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b1fb5-c430-40e0-88d3-6e5222d00a88 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.634250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b1fb5-c430-40e0-88d3-6e5222d00a88 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.636149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b1fb5-c430-40e0-88d3-6e5222d00a88 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.636149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 16/28] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:19.638431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130323b-ae85-4323-8bd2-5b6bf8d1e647 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.638715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130323b-ae85-4323-8bd2-5b6bf8d1e647 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.639899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a130323b-ae85-4323-8bd2-5b6bf8d1e647 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.642173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 17/29] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:19 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:19.643214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130323b-ae85-4323-8bd2-5b6bf8d1e647 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:19.659364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:19.660348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.660900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.661352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.662288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:19.662772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:19.664627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca0e6af-1dd9-45ff-a6f6-bce5fe5c4e7a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:19.679785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 13/30] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:19.681424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e9c56-ebeb-4152-912c-476ef0a7d643 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.681883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e9c56-ebeb-4152-912c-476ef0a7d643 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.682347 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c41e9c56-ebeb-4152-912c-476ef0a7d643 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.700721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c41e9c56-ebeb-4152-912c-476ef0a7d643 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:19.702449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c41e9c56-ebeb-4152-912c-476ef0a7d643 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:19.729283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:19.732321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:19.779981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a130323b-ae85-4323-8bd2-5b6bf8d1e647 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:19.793747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 14/31] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:19.795540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.795933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.796770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.817607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:19.818291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:19.819060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:19.819328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.819801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.820229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.821179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:19.821622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:19.823249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:19.832822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 18/32] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:19 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:19.833941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:19.912368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 15/33] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:19.913224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:19.953939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb99ac2-70bc-47f5-b169-5b76b85dd9d4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:19.984396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:19.994785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:19.995885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:19.996387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:19.996865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:19.997771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:19.999527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.014321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:20.027762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f86977-7b30-45ae-a259-bc84a2f0d029 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:20.064766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:20.066186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.066536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.066882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.067717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:20.069167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.221897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 19/34] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:56:19 2022] POST /identity/v3/projects => generated 301 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:20.223236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:20.269704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 16/35] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 6 16:56:19 2022] POST /identity/v3/roles => generated 225 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:20.271287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:20.419376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20c54b07-f00f-4c0c-9cb0-bf3117542919 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:20.510981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7eab99-8ac0-44c9-9718-f7aef20a9751 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:20.559451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323bc02-7fae-4306-ba14-82f6032696be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:20.560252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323bc02-7fae-4306-ba14-82f6032696be None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.560612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323bc02-7fae-4306-ba14-82f6032696be None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.560987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323bc02-7fae-4306-ba14-82f6032696be None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.561807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323bc02-7fae-4306-ba14-82f6032696be None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:20.565903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e323bc02-7fae-4306-ba14-82f6032696be None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.606084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40c9a356-a560-4e15-9398-0855091d0436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:20.607035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a356-a560-4e15-9398-0855091d0436 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.607381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a356-a560-4e15-9398-0855091d0436 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.607672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40c9a356-a560-4e15-9398-0855091d0436 None admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.608999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a356-a560-4e15-9398-0855091d0436 None admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:20.610692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40c9a356-a560-4e15-9398-0855091d0436 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.613296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 20/36] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:20 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 390 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:20.614628 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eb8e2-c5e2-40c1-b078-29bfb8c7a10f None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.614924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eb8e2-c5e2-40c1-b078-29bfb8c7a10f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.615207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703eb8e2-c5e2-40c1-b078-29bfb8c7a10f None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.616516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 21/37] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:20.619176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703eb8e2-c5e2-40c1-b078-29bfb8c7a10f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:20.637807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 17/38] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 6 16:56:20 2022] POST /identity/v3/roles => generated 219 bytes in 367 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:20.639291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.639594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.639880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.659237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:20.660950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:20.670249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:20.689352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:20.746178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 18/39] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:20.766517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703eb8e2-c5e2-40c1-b078-29bfb8c7a10f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:20.775396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:20.809849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1279f529-e1ef-4a69-8d58-c314d7fbb699 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:20.810716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f529-e1ef-4a69-8d58-c314d7fbb699 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.811005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f529-e1ef-4a69-8d58-c314d7fbb699 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.811289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1279f529-e1ef-4a69-8d58-c314d7fbb699 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.812614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f529-e1ef-4a69-8d58-c314d7fbb699 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:20.814107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1279f529-e1ef-4a69-8d58-c314d7fbb699 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.816315 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 22/40] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:20 2022] GET /identity/v3/domains/default => generated 199 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:20.817582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17647-7efd-48d8-94a8-a3e28847a91c None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.817871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17647-7efd-48d8-94a8-a3e28847a91c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.818186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c17647-7efd-48d8-94a8-a3e28847a91c None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.819418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 23/41] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:20.821776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c17647-7efd-48d8-94a8-a3e28847a91c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:20.895717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227b8c1b-7221-4d62-a157-c0811d68fceb None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:20.930739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c17647-7efd-48d8-94a8-a3e28847a91c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:20.930941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55bc8f83-5587-422f-b453-425fd4ebe0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:20.931609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8f83-5587-422f-b453-425fd4ebe0c2 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.931896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8f83-5587-422f-b453-425fd4ebe0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.932179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bc8f83-5587-422f-b453-425fd4ebe0c2 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.932917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc8f83-5587-422f-b453-425fd4ebe0c2 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:20.934342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55bc8f83-5587-422f-b453-425fd4ebe0c2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.944726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:20.963937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:20.964809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:20.965095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:20.965377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] PATH_INFO: `/v3/domains/default/users/861320b46d7645f3b4d8d49005174ddc/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:20.967431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=861320b46d7645f3b4d8d49005174ddc, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:20.968876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:20.993320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:20.998967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 19/42] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 6 16:56:20 2022] POST /identity/v3/roles => generated 223 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:21.000178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:21.000468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:21.000750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:21.018665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:21.019823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:21.065687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 24/43] 10.222.0.20 () {58 vars in 1361 bytes} [Wed Jul 6 16:56:20 2022] PUT /identity/v3/domains/default/users/861320b46d7645f3b4d8d49005174ddc/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:56:21.095131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 20/44] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:21.119854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:21.238680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fbd8547-a553-407d-af6e-3699f210ef91 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:21.272570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87db4aa4-0ae8-4b43-b0e0-a383fbf4fe78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:21.273284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4aa4-0ae8-4b43-b0e0-a383fbf4fe78 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:21.273568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4aa4-0ae8-4b43-b0e0-a383fbf4fe78 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:21.273842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87db4aa4-0ae8-4b43-b0e0-a383fbf4fe78 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:21.275036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4aa4-0ae8-4b43-b0e0-a383fbf4fe78 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:21.276484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87db4aa4-0ae8-4b43-b0e0-a383fbf4fe78 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:21.278114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 25/45] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:21.283649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:21.379943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-562d1337-3df4-4c96-93f9-2ea2f50baa69 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:21.406074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:21.414139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e45b601-d309-4eeb-b851-770e658ce53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:21.414805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b601-d309-4eeb-b851-770e658ce53a None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:21.420302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b601-d309-4eeb-b851-770e658ce53a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:21.420302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e45b601-d309-4eeb-b851-770e658ce53a None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:21.420302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b601-d309-4eeb-b851-770e658ce53a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:21.420302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e45b601-d309-4eeb-b851-770e658ce53a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:21.491128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 21/46] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:56:21 2022] POST /identity/v3/projects => generated 312 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:23.086776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592a784-e3e2-45f2-959f-2d13437eaca5 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.087284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592a784-e3e2-45f2-959f-2d13437eaca5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.087368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3592a784-e3e2-45f2-959f-2d13437eaca5 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.088726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 26/47] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:23.094016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.094426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.094615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.111053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:23.112264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:23.176888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 22/48] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:23.200264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592a784-e3e2-45f2-959f-2d13437eaca5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.245075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:23.301510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3592a784-e3e2-45f2-959f-2d13437eaca5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:23.336313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8dd6aa5-0f81-44b3-ad79-b6433467b260 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:23.337151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6aa5-0f81-44b3-ad79-b6433467b260 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.337395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6aa5-0f81-44b3-ad79-b6433467b260 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.337681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8dd6aa5-0f81-44b3-ad79-b6433467b260 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.347657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8dd6aa5-0f81-44b3-ad79-b6433467b260 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-f8dd6aa5-0f81-44b3-ad79-b6433467b260 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:23.355322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:23.356144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:23.356892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 27/49] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:23.362380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.458443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5303bd62-6232-4d1e-9cb1-a0419151eee7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:23.469468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:23.492292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:23.492960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.493247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.493527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.494360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:23.494673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:23.496071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:23.501093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042f53-efc4-4abd-b512-58ea18789beb None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.501458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042f53-efc4-4abd-b512-58ea18789beb None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.501817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee042f53-efc4-4abd-b512-58ea18789beb None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.503854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 28/50] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:23.508581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 23/51] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:23.509181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.509483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.509885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.513926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.527266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:23.528865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:23.604292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 29/52] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:23.628216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.658536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:23.718572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-279e7f02-e8ab-4dfe-8d85-726a864ddc32 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:23.726446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7effdebe-a3e5-413e-b6df-aecccb7e8804 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:23.752315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:23.753694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.753974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.754284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.755695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:23.757501 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:23.759149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 24/53] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:23 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:23.761322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:23.762148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.762438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.762720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.764097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:23.764475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.765545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:23.767194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 30/54] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:23.772633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.805843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:23.864234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29f3b406-bd88-43b6-8a54-ec44d47d3b15 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:23.871482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:23.874333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dc42b2-b8a7-4b6c-9d0d-bd6f6a850594 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:23.897485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:23.898299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.898587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.898866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.900047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:23.901548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:23.903197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 25/55] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:23.907536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034c3249-4112-435d-b16e-1b178d1c4396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:23.911782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c3249-4112-435d-b16e-1b178d1c4396 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:23.911782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c3249-4112-435d-b16e-1b178d1c4396 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:23.911958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:23.912039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034c3249-4112-435d-b16e-1b178d1c4396 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:23.912039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c3249-4112-435d-b16e-1b178d1c4396 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:23.912039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034c3249-4112-435d-b16e-1b178d1c4396 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:24.007762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78b6b1a-c064-465f-b310-1a14ddda2765 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:24.016203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:24.040482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:24.041140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:24.041426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:24.041707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:24.042580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.domain.id=default, user.id=861320b46d7645f3b4d8d49005174ddc) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:24.042967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:24.044408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2734078-4dab-4b80-98d4-8bed8f32f84b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:24.051666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 31/56] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Jul 6 16:56:23 2022] POST /identity/v3/projects => generated 298 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:56:24.056409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 26/57] 10.222.0.20 () {56 vars in 1322 bytes} [Wed Jul 6 16:56:23 2022] GET /identity/v3/role_assignments?user.id=861320b46d7645f3b4d8d49005174ddc&scope.domain.id=default&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 530 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:26.082936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0087cf-560d-4be8-9955-7e33603bb486 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:26.083436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0087cf-560d-4be8-9955-7e33603bb486 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:26.083541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0087cf-560d-4be8-9955-7e33603bb486 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:26.084858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 32/58] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:26.089828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:26.090229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:26.090436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:26.107240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:26.108420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:26.173939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 27/59] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:26.198923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0087cf-560d-4be8-9955-7e33603bb486 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:26.318325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0087cf-560d-4be8-9955-7e33603bb486 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:26.351107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef65958b-6850-4d2d-9306-8235291a76a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:26.351826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65958b-6850-4d2d-9306-8235291a76a2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:26.352107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65958b-6850-4d2d-9306-8235291a76a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:26.352381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef65958b-6850-4d2d-9306-8235291a76a2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:26.353536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65958b-6850-4d2d-9306-8235291a76a2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:26.355081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef65958b-6850-4d2d-9306-8235291a76a2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:26.356697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 33/60] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:26.362157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:26.462317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5309735e-658b-43a8-9916-26bfef8bfafe None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:26.463815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:26.497952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e03a8a-00ab-49d2-aaab-0374e0d9fa62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:26.498657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03a8a-00ab-49d2-aaab-0374e0d9fa62 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:26.498942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03a8a-00ab-49d2-aaab-0374e0d9fa62 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:26.499223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e03a8a-00ab-49d2-aaab-0374e0d9fa62 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:26.499948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03a8a-00ab-49d2-aaab-0374e0d9fa62 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:26.501413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e03a8a-00ab-49d2-aaab-0374e0d9fa62 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:26.612440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 28/61] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:26 2022] POST /identity/v3/users => generated 275 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:56:29.780093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955c16-fabb-46de-8161-5d71fa16aa09 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:29.781151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955c16-fabb-46de-8161-5d71fa16aa09 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:29.781649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1955c16-fabb-46de-8161-5d71fa16aa09 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:29.783255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 34/62] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:29.788746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc10752-fc28-4319-a114-1a7e029cc8e0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:29.789577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc10752-fc28-4319-a114-1a7e029cc8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:29.790176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcc10752-fc28-4319-a114-1a7e029cc8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:29.800988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285abc4-06b1-4acf-b2d7-664fe90b9273 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:29.805691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285abc4-06b1-4acf-b2d7-664fe90b9273 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:29.806225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f285abc4-06b1-4acf-b2d7-664fe90b9273 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:29.807803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 35/63] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:29 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:29.813874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d0b8-5ffa-4e43-b0bc-e58aa5f1fc8c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:29.814202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d0b8-5ffa-4e43-b0bc-e58aa5f1fc8c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:29.814496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7524d0b8-5ffa-4e43-b0bc-e58aa5f1fc8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:29.820612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-bcc10752-fc28-4319-a114-1a7e029cc8e0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:29.821860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-bcc10752-fc28-4319-a114-1a7e029cc8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:29.848813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7524d0b8-5ffa-4e43-b0bc-e58aa5f1fc8c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:29.850016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7524d0b8-5ffa-4e43-b0bc-e58aa5f1fc8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:29.898409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:29.942056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 29/64] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:29.964911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aa942-ebe2-40d4-8d61-3431c9b67c06 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:29.965541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aa942-ebe2-40d4-8d61-3431c9b67c06 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:29.966055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95aa942-ebe2-40d4-8d61-3431c9b67c06 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:29.967644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 30/65] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:29.968555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aa942-ebe2-40d4-8d61-3431c9b67c06 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:29.980362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 36/66] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:29.982012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:29.990557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:29.991060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.017412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:30.019143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:30.077038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.093585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95aa942-ebe2-40d4-8d61-3431c9b67c06 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.099079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 37/67] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:30.100051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.134679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.136195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.136764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.137200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.152703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:30.164899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:30.166100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:30.166897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:30.167495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 31/68] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:29 2022] GET /identity/v3/roles/member => generated 84 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:30.173426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.209047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.230870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7343d3d-23a3-4c7b-94e5-8c8dcd3d99c6 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.270002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.270937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.271239 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.271519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.281994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:30.290759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:30.291624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:30.292403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 38/69] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:30.293704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.299398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955fa198-04ff-429b-b5fb-6656491276a4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.336172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-484c87cd-1a2a-47e7-95ba-17bd5dec7d07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.337220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c87cd-1a2a-47e7-95ba-17bd5dec7d07 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.337515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c87cd-1a2a-47e7-95ba-17bd5dec7d07 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.337799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-484c87cd-1a2a-47e7-95ba-17bd5dec7d07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.348876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-484c87cd-1a2a-47e7-95ba-17bd5dec7d07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-484c87cd-1a2a-47e7-95ba-17bd5dec7d07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:30.356549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:30.357404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:30.358205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 32/70] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/roles/admin => generated 83 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:30.359173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad087-afd5-4309-a308-62cc593d808e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.359454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad087-afd5-4309-a308-62cc593d808e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.359739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73ad087-afd5-4309-a308-62cc593d808e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.361155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 33/71] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:30.363748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad087-afd5-4309-a308-62cc593d808e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.376154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.406661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f68077-9ac7-40f4-a6f9-ef37ab89be1b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.441713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.442407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.442696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.442975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.443727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:30.444036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:30.445426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:30.454441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 39/72] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:30.455769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.458459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.473512 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73ad087-afd5-4309-a308-62cc593d808e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.506130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.507043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.507326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.507612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.508353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:30.508667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:30.510059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8e64b3e-e28b-4768-8157-1246b4550587 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:30.518389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 34/73] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:30.519529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdc438-d11b-49ae-a283-bd215c71983f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.519814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdc438-d11b-49ae-a283-bd215c71983f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.520093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fdc438-d11b-49ae-a283-bd215c71983f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.536098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b8fdc438-d11b-49ae-a283-bd215c71983f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:30.537273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b8fdc438-d11b-49ae-a283-bd215c71983f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:30.562865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92cd57ef-e8ff-4380-bafb-8311522fc7c7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.597197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.597799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.598118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.598405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.599157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:30.599479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:30.599769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.600856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:30.604230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 35/74] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:30.605490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca043f0-dc58-40cf-894d-a3255d2c85a6 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.605778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca043f0-dc58-40cf-894d-a3255d2c85a6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.606074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca043f0-dc58-40cf-894d-a3255d2c85a6 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.607497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 36/75] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:30.615415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 40/76] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:30.615553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca043f0-dc58-40cf-894d-a3255d2c85a6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.615634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.680506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.714572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca043f0-dc58-40cf-894d-a3255d2c85a6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.719318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129e2b6f-7861-45e8-9fb5-484fb61ea1c8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.748319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50196b5a-9381-4f94-87da-a78bf628f14c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.749176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50196b5a-9381-4f94-87da-a78bf628f14c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.749460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50196b5a-9381-4f94-87da-a78bf628f14c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.749735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50196b5a-9381-4f94-87da-a78bf628f14c None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.752684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.753560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.753853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.754169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.764553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50196b5a-9381-4f94-87da-a78bf628f14c None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:30.766010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50196b5a-9381-4f94-87da-a78bf628f14c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:30.767480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:30.767697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 37/77] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:30.769389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.769673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.769831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:30.769957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.771553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 41/78] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:30.772314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.786582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:30.787765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:30.839360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.853314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 38/79] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:30.853314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.883694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2275d8f8-c190-40b3-a78b-a3782a3e4080 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.906444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:30.917670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.918574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.918857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.919133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.920323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:30.921773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:30.923456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 42/80] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:30.924826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:30.952362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3904ef9f-0139-4976-8fb8-7f7f53dbdcde None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:30.984739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:30.985524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:30.985804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:30.986108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:30.996888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:31.005254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:31.006140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 39/81] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:31.007672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.033334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c660fff7-5992-4c08-b9d9-4b8f3ab32069 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.055926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.066869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.067573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.067880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.068162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.107184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09695dbf-005c-4044-bddb-0e46fd21f669 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.125180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.136399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.137857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.140095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.140732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.141018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.141297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.207247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.208830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.234548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 43/82] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:31.239757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.255855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.306231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 40/83] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:31.307058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.332771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.341978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f88b28b-c512-4829-9821-bf0bcf3d4ea8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.376722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.377480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.377795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.378098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.379652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.381456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.383674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 44/84] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:31.384431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.404270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b322ddf-98f5-4339-a711-0edb1d6c74aa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.437796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.438462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.438752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.439032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.456727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.481147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54bd0388-2361-4747-ae0f-2176b8f8c656 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.506362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.508098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.515184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.515851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.516140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.516424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.517181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:31.517501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.518943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.527057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 45/85] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:31.527648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.553192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.606648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 41/86] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 300 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:31.607482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.635124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3719bf4-ac46-4ccc-8f38-c97644ac262b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.654020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.668867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.669783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.670100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.670388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.671584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.673055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.675546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 46/87] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:31.676119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.704969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0142ec-8e47-457f-b688-70d18c3c5f78 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.738601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.739463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.739751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.740029 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.741215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.742699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.744389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 42/88] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:31.745143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.761899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.774228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24319273-77f7-459d-b424-a842a8ae404a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.807875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.808539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.808826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.809103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.809850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.811332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.841136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22df7a3-c7d3-4c40-97b2-b611539d4448 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:31.857223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:31.874095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:31.875005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:31.875290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:31.875568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:31.876765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:31.878241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:31.879911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 43/89] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:31.880671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.898166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 47/90] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:31 2022] POST /identity/v3/users => generated 289 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:31.898974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:31.999720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f61a41-62b0-4460-bd3d-311b0dc73507 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.008132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f22748-fc71-4c02-aa1e-8ca2d63fe95a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.038626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.039495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.039777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.040053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.041316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.042741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.049752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 44/91] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:32.049752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:32.055475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.056149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.056443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.056719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.057568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] RBAC: Adding query filter params (role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=7d464cf1e672441c9fee71e315390413) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:32.057884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.059379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.066643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 48/92] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:31 2022] GET /identity/v3/role_assignments?user.id=7d464cf1e672441c9fee71e315390413&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:32.067366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:32.082224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:32.115412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:32.186755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25700e0f-baa4-42e9-ad8f-756c893d9f44 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.211737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ecc8b14-09ef-4849-948b-f565b61d3834 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.234499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.235776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.236163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.237187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.238384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=7d464cf1e672441c9fee71e315390413) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:32.238804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.241326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.249415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 45/93] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:32 2022] GET /identity/v3/role_assignments?user.id=7d464cf1e672441c9fee71e315390413&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 259 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:32.250537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:32.258357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.259034 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.259326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.259612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.358818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.360330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.373126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:32.430779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dfc37d5-6492-4c80-9117-4d38e3fcfd0b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.462500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:32.492294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.492966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.493252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.493536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.494428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=861320b46d7645f3b4d8d49005174ddc) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:32.495382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.496883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.503961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 46/94] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:32 2022] GET /identity/v3/role_assignments?user.id=861320b46d7645f3b4d8d49005174ddc&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:32.563308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 49/95] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:32.569220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:32.727574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a330288b-fd3e-4b5a-9e61-bd26c3111c26 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.762990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49180444-16cf-4c7a-9786-286e905e82b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.763859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180444-16cf-4c7a-9786-286e905e82b0 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.764146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180444-16cf-4c7a-9786-286e905e82b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.764425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49180444-16cf-4c7a-9786-286e905e82b0 None admin] PATH_INFO: `/v3/projects/2205467d618b47d983fcaca570b1aa54` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.765650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49180444-16cf-4c7a-9786-286e905e82b0 None admin] RBAC: Authorizing `identity:get_project(project_id=2205467d618b47d983fcaca570b1aa54)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.767140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49180444-16cf-4c7a-9786-286e905e82b0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.769397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 47/96] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:32 2022] GET /identity/v3/projects/2205467d618b47d983fcaca570b1aa54 => generated 312 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:32.775497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:32.906604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03af0183-4660-400d-8b73-c7106989f203 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:32.915972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:32.948338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:32.949018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:32.949307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:32.949592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:32.950474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=2205467d618b47d983fcaca570b1aa54, user.id=7d464cf1e672441c9fee71e315390413) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:32.950793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:32.952259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-622db76b-461f-4fe9-aa40-725bc319bc63 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:32.958743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 50/97] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:32 2022] GET /identity/v3/role_assignments?user.id=7d464cf1e672441c9fee71e315390413&scope.project.id=2205467d618b47d983fcaca570b1aa54&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 259 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:34.633402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5164f-7aa9-4cd1-8014-cb1b918d0e54 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:34.634396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5164f-7aa9-4cd1-8014-cb1b918d0e54 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:34.634869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c5164f-7aa9-4cd1-8014-cb1b918d0e54 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:34.636440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 48/98] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:34 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:34.641746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:34.642554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:34.643080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:34.660643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:34.662206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:34.739930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 51/99] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:34.777004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5164f-7aa9-4cd1-8014-cb1b918d0e54 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:34.840959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:34.894057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c5164f-7aa9-4cd1-8014-cb1b918d0e54 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:34.929498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a138b025-283e-4e41-bba9-b395548047fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:34.930683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b025-283e-4e41-bba9-b395548047fb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:34.931164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b025-283e-4e41-bba9-b395548047fb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:34.931651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a138b025-283e-4e41-bba9-b395548047fb None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:34.933021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b025-283e-4e41-bba9-b395548047fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:34.934692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a138b025-283e-4e41-bba9-b395548047fb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:34.936527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 49/100] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:34.942256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:35.069718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-512f5a1c-56d7-4536-9582-d132caf7a001 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:35.071587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:35.116861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:35.117885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.118410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.118895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.119803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:35.121472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:35.191814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b5ea-bafe-45eb-8143-90c54c8bd327 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.192092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b5ea-bafe-45eb-8143-90c54c8bd327 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.192410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c81b5ea-bafe-45eb-8143-90c54c8bd327 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.193747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 50/101] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:35.199099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd227-6855-49c5-937c-5aca84324ca1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.199396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd227-6855-49c5-937c-5aca84324ca1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.199806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c3dd227-6855-49c5-937c-5aca84324ca1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.226391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3c3dd227-6855-49c5-937c-5aca84324ca1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:35.227640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3c3dd227-6855-49c5-937c-5aca84324ca1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:35.228959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 52/102] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:56:34 2022] POST /identity/v3/projects => generated 302 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:35.327706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 51/103] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:35.364354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:35.499124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8fc5-7d82-4ee6-b346-54cc584d3605 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.499471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8fc5-7d82-4ee6-b346-54cc584d3605 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.499655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91fd8fc5-7d82-4ee6-b346-54cc584d3605 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.501232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 52/104] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:35.507770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99482-88cf-4d22-a7d9-124351b7d8ca None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.508067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99482-88cf-4d22-a7d9-124351b7d8ca None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.508356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc99482-88cf-4d22-a7d9-124351b7d8ca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.520353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afb1861-cd74-4c45-960b-be6c5d756370 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:35.539398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3fc99482-88cf-4d22-a7d9-124351b7d8ca None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:35.540861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3fc99482-88cf-4d22-a7d9-124351b7d8ca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:35.587803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afbd704c-13fc-44c7-a393-e0270bff8153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:35.588967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd704c-13fc-44c7-a393-e0270bff8153 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.589445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd704c-13fc-44c7-a393-e0270bff8153 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.589944 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afbd704c-13fc-44c7-a393-e0270bff8153 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.604306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afbd704c-13fc-44c7-a393-e0270bff8153 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-afbd704c-13fc-44c7-a393-e0270bff8153 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:35.615126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:35.615985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:35.616726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:35.619542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 53/105] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:35.621340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa9a9-49f2-484b-97f4-3b3ecb6dbc27 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.621775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa9a9-49f2-484b-97f4-3b3ecb6dbc27 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.622504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32aa9a9-49f2-484b-97f4-3b3ecb6dbc27 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.624011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 54/106] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:35.624921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa9a9-49f2-484b-97f4-3b3ecb6dbc27 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:35.630298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:35.646337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 53/107] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:35.648657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666baee9-9c9c-4c0d-b940-e4bbcc6c9fa2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.649161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666baee9-9c9c-4c0d-b940-e4bbcc6c9fa2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.649645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666baee9-9c9c-4c0d-b940-e4bbcc6c9fa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.651151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:35.669145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-666baee9-9c9c-4c0d-b940-e4bbcc6c9fa2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:35.670888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-666baee9-9c9c-4c0d-b940-e4bbcc6c9fa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:35.750636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 54/108] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:35.752945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2490-f36a-432d-95fc-60819ed79f13 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.753447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2490-f36a-432d-95fc-60819ed79f13 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.753916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ae2490-f36a-432d-95fc-60819ed79f13 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.755388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 55/109] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:35 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:35.756274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2490-f36a-432d-95fc-60819ed79f13 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:35.812550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32aa9a9-49f2-484b-97f4-3b3ecb6dbc27 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:35.849638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:35.851107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.851844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.852523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.854041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:35.854603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:35.856215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ced3a6aa-5d75-4215-abb6-28535c7c6363 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:35.865864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 55/110] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:35.867420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.867909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.868399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.891735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:35.893067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:35.893439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ae2490-f36a-432d-95fc-60819ed79f13 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:35.903700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:35.934223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:35.935696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:35.936202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:35.936718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:35.948448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:35.957859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:35.958718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:35.959458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:35.962019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 56/111] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:56:35 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:35.963016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:35.978421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 56/112] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:35.979568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:35.989843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.080966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107caf13-5e24-4288-997d-572b19208fe5 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.089910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d1c4ff-103d-4985-8e0b-99837aeeaf50 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.118991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15a7867-ab93-4c1a-a018-b503446cbc4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.120227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7867-ab93-4c1a-a018-b503446cbc4d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.120706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7867-ab93-4c1a-a018-b503446cbc4d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.121173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15a7867-ab93-4c1a-a018-b503446cbc4d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.124115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.124970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.125255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.125534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.126732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.128201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.129823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 57/113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:35 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.130604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.137694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f15a7867-ab93-4c1a-a018-b503446cbc4d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f15a7867-ab93-4c1a-a018-b503446cbc4d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:36.147308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:36.148146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:36.148908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:36.149482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 57/114] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:36.150825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ae44-cacd-4cd5-acf4-0f8358235859 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.151125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ae44-cacd-4cd5-acf4-0f8358235859 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.151409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1f9ae44-cacd-4cd5-acf4-0f8358235859 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.154529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 58/115] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:36.154529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ae44-cacd-4cd5-acf4-0f8358235859 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.185475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.216206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.240428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96c04648-87b5-4c9c-aa62-4696d8293f42 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.269098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1f9ae44-cacd-4cd5-acf4-0f8358235859 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.276668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.277388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.277675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.277954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.278754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:36.279089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.280469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.289792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 58/116] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.290788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.306661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.307544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.307924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.308293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.319538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:36.327274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:36.328289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:36.329239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:36.331269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 59/117] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:36.331787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.398348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae5ac6-58b6-46ce-8760-e25be255dc2e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.425753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.435815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768a7187-8790-48a9-a092-fd71dad04601 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.436900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7187-8790-48a9-a092-fd71dad04601 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.446943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7187-8790-48a9-a092-fd71dad04601 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.446943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768a7187-8790-48a9-a092-fd71dad04601 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.446943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a7187-8790-48a9-a092-fd71dad04601 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.446943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768a7187-8790-48a9-a092-fd71dad04601 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.447291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42bb62ad-3763-4d1c-a80e-6655eab304ee None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.447375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 59/118] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.447375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.447375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.447375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.450073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.461590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:36.463030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:36.484379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.485055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.485616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.485906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.486892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] RBAC: Adding query filter params (name=reader) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:36.487259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.489279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.503719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 60/119] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.503719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.538050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 60/120] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:36.539037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.611709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9909cc6d-9982-4c25-9caa-95e38335256c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.648941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.649824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.650164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.650514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.651738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.653188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.655108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 61/121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.655757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.667275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b472e33-3ee2-408d-bb21-85e7a7910049 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.675524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.708232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.709067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.709380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.709677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.710460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:36.710768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.712157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.714188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:36.720997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 61/122] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.721780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.769902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b90a30a1-b179-410f-9b5f-f753a536c52f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.852124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4b0523-9391-4737-a243-8278b21811cc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:36.853859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.854779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.855059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.855332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/7d464cf1e672441c9fee71e315390413/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.857352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a4ead08b54228b90c614639eb6dcf, user_id=7d464cf1e672441c9fee71e315390413, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.858818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.885698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:36.886539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:36.886906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:36.887185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] PATH_INFO: `/v3/users/cffd9a89d03f426c964a2a582c645fae` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:36.900917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] RBAC: Authorizing `identity:get_user(user_id=cffd9a89d03f426c964a2a582c645fae)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:36.902414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:36.904065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 62/123] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/users/cffd9a89d03f426c964a2a582c645fae => generated 289 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:36.904823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.924817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 62/124] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:36 2022] PUT /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/7d464cf1e672441c9fee71e315390413/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 269 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:56:36.925496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:36.985355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.018933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.045733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0e07e30-6278-441c-b452-5704019d14b1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.047102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba00abde-f1e1-4823-a3c2-79a09183f4a0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.089876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.090869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.091160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.091466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.093190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.095785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.095893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.095893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.096054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.096993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.097101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 63/125] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:37.097753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.114304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:37.122627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:37.123471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:37.124244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 63/126] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:36 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:37.124865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.228708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b9d6e06-e882-4412-a124-9ffa45511f1e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.235829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b7e3d61-a735-415a-bcca-f198b4de60e9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.250554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.272066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.273045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.273332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.273614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.273903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.274688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.274840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.275158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.275594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.276278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.278351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 64/127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:37.280230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.298289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.350490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.352153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.415360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7290df9c-e390-4758-a1f3-738038868869 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.452464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.453589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.454017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.454454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/7d464cf1e672441c9fee71e315390413/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.456873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a4ead08b54228b90c614639eb6dcf, user_id=7d464cf1e672441c9fee71e315390413, role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.461486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 64/128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:37.461486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.463466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.474617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.577827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c770782-eb53-40a8-82d5-e484e5555cd2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.604039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.604723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.605013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.605297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.606077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:37.606407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.607800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.617238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 65/129] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:37.620626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.624227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 65/130] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:37 2022] PUT /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/7d464cf1e672441c9fee71e315390413/roles/f63a187bba4e41e586f5700d586f8a89 => generated 0 bytes in 345 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:56:37.630220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.724752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.738440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:37.740507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6c22af-16de-4c47-92ba-47941164b122 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.768909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cead4a71-ec5c-4d69-98a4-053eba5176d2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.788372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.793603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.793603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.793603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.793603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.793603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.796129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 66/131] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:37.797057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.808033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cefce91-5fe4-42b8-a948-548421ddfc7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.809993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefce91-5fe4-42b8-a948-548421ddfc7f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.809993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefce91-5fe4-42b8-a948-548421ddfc7f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.809993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cefce91-5fe4-42b8-a948-548421ddfc7f None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.810613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefce91-5fe4-42b8-a948-548421ddfc7f None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.812216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cefce91-5fe4-42b8-a948-548421ddfc7f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.814344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 66/132] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:37.815692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11018-7bbe-4b2f-ab3c-19e9037d3dc9 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.815987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11018-7bbe-4b2f-ab3c-19e9037d3dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.816269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e11018-7bbe-4b2f-ab3c-19e9037d3dc9 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.817636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 67/133] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:37.821864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11018-7bbe-4b2f-ab3c-19e9037d3dc9 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:37.937095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e11018-7bbe-4b2f-ab3c-19e9037d3dc9 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.937815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d7aa27-e4c9-4148-b5f4-308ece9a79c3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:37.974183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727ab13c-0334-453a-80db-4db202414975 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.975495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab13c-0334-453a-80db-4db202414975 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.976036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab13c-0334-453a-80db-4db202414975 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.976513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727ab13c-0334-453a-80db-4db202414975 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/861320b46d7645f3b4d8d49005174ddc/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.978694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ab13c-0334-453a-80db-4db202414975 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a4ead08b54228b90c614639eb6dcf, user_id=861320b46d7645f3b4d8d49005174ddc, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.980776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727ab13c-0334-453a-80db-4db202414975 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.982544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:37.983429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:37.983720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:37.984002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:37.986000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:37.987668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:37.989565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 67/134] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:37.994136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:38.009581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:38.067100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:38.071522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 68/135] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:37 2022] PUT /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/861320b46d7645f3b4d8d49005174ddc/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:56:38.079850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:38.082395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:38.082724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:38.121022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:38.124301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:38.135844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c1e2955-f151-4586-9aa2-d464c8e0b6a3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:38.178255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:38.178931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:38.179220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:38.179506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:38.180359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] RBAC: Adding query filter params (role.id=b0ae3f6fe25548e09f0335aa34585ca1, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=cffd9a89d03f426c964a2a582c645fae) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:38.180679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:38.182352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:38.188972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 68/136] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:37 2022] GET /identity/v3/role_assignments?user.id=cffd9a89d03f426c964a2a582c645fae&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=b0ae3f6fe25548e09f0335aa34585ca1 => generated 259 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:38.190341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:38.288014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 69/137] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:38.317127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:38.328331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:38.362091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0c634d8-47e2-43d3-8927-fc66992924e2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:38.429912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:38.431491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:38.431790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:38.432078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] PATH_INFO: `/v3/projects/2205467d618b47d983fcaca570b1aa54` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:38.433452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] RBAC: Authorizing `identity:get_project(project_id=2205467d618b47d983fcaca570b1aa54)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:38.439448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:38.441897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 69/138] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:38 2022] GET /identity/v3/projects/2205467d618b47d983fcaca570b1aa54 => generated 312 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:38.447837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:38.568744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5944b0a2-281c-48c0-b2d2-9838eee5e74d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:38.575993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8cd4de8-3116-4704-870a-d6b5a1482843 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:38.604245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce48ba24-1617-4e05-9582-100916bf9447 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:38.605145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48ba24-1617-4e05-9582-100916bf9447 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:38.605435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48ba24-1617-4e05-9582-100916bf9447 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:38.605718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce48ba24-1617-4e05-9582-100916bf9447 None admin] PATH_INFO: `/v3/projects/2205467d618b47d983fcaca570b1aa54/users/7d464cf1e672441c9fee71e315390413/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:38.607802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48ba24-1617-4e05-9582-100916bf9447 None admin] RBAC: Authorizing `identity:create_grant(project_id=2205467d618b47d983fcaca570b1aa54, user_id=7d464cf1e672441c9fee71e315390413, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:38.609279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce48ba24-1617-4e05-9582-100916bf9447 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:38.629092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:38.629968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:38.631934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:38.631934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:38.632100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:38.633638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:38.635310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 70/139] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:38.635785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:38.640776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:38.693364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 70/140] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:38 2022] PUT /identity/v3/projects/2205467d618b47d983fcaca570b1aa54/users/7d464cf1e672441c9fee71e315390413/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:56:38.757397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5634a902-e74b-447d-bd62-017b15a73b06 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:38.798450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a757e11-11cb-4cc3-ad75-3eb594fdeac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:38.799718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a757e11-11cb-4cc3-ad75-3eb594fdeac4 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:38.800007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a757e11-11cb-4cc3-ad75-3eb594fdeac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:38.800291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a757e11-11cb-4cc3-ad75-3eb594fdeac4 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:38.801028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a757e11-11cb-4cc3-ad75-3eb594fdeac4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:38.802520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a757e11-11cb-4cc3-ad75-3eb594fdeac4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:38.922180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 71/141] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:38 2022] POST /identity/v3/users => generated 283 bytes in 281 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:39.415123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff74c7-5034-40db-a475-058278f6e9bf None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:39.415626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff74c7-5034-40db-a475-058278f6e9bf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:39.415729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74ff74c7-5034-40db-a475-058278f6e9bf None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:39.417346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 71/142] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:39.432836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:39.433126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:39.433413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:39.453981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:39.457641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:39.520656 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:39.542073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 72/143] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:39.577080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff74c7-5034-40db-a475-058278f6e9bf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:39.584232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:39.783859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74ff74c7-5034-40db-a475-058278f6e9bf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:39.839847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:39.840670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:39.840959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:39.841242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:39.853854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:39.861818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:39.862765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:39.863569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 72/144] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:39 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:39.870336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:40.032181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3cd7c-d972-438f-933c-dd5d88bebbad None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:40.093640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:40.094391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:40.094680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:40.094963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:40.095804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] RBAC: Adding query filter params (name=member) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:40.096117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:40.097550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:40.112842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 73/145] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:39 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:40.118276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:40.211743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:40.253338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7982d33-8890-4d58-913d-a15c528aaf66 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:40.290587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:40.291473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:40.291759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:40.292036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:40.293243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:40.294743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:40.296376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 73/146] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:40 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:40.301895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:40.351618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:40.414139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38eb1652-c363-47fb-ac32-049469467f9c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:40.451955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29f1a4d-bbfe-4928-896f-9fd7338378fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:40.452607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1a4d-bbfe-4928-896f-9fd7338378fa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:40.452895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1a4d-bbfe-4928-896f-9fd7338378fa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:40.453177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29f1a4d-bbfe-4928-896f-9fd7338378fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:40.533077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f1a4d-bbfe-4928-896f-9fd7338378fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:40.533077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29f1a4d-bbfe-4928-896f-9fd7338378fa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:40.593721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:40.655768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 74/147] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 354 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:40.661329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:40.671312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2d2b-c7ad-4b63-8d62-927a365061af None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:40.671600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2d2b-c7ad-4b63-8d62-927a365061af None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:40.671879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7eb2d2b-c7ad-4b63-8d62-927a365061af None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:40.677849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 75/148] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:40 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:40.679156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:40.679444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:40.679725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:40.715614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:40.716811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:40.834765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 76/149] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:40.837259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378e3cb4-d6e2-43b6-a9fa-81efdb3bc244 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:40.878379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:40.883483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:40.884362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:40.884645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:40.884917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:40.886130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:40.887593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:40.889600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 74/150] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:40 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:40.895659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:40.903103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:41.011295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42300560-ad23-42bb-a3b5-662c9b44e84c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:41.048056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:41.049424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.049885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.050392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.058020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:41.061169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:41.069861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:41.074897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:41.075673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 75/151] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:56:40 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:41.089235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa37ee2e-5157-42f7-8db4-de22542e088a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:41.091476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:41.159783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:41.160598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.160886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.161165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.162012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=7d464cf1e672441c9fee71e315390413) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:41.162341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:41.163779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:41.170538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 77/152] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:40 2022] GET /identity/v3/role_assignments?user.id=7d464cf1e672441c9fee71e315390413&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:41.222459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:41.273189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29cc9d80-7c3c-4739-8f49-5c3480459eec None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:41.315248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:41.315925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.316215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.316498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.317261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:41.317571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:41.318997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:41.334472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 76/153] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:56:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:41.339765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:41.485694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94b6ec6-cc4e-46b4-981b-99839c5837a2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:41.527574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89b004ff-5c1e-4778-a40f-a4160f692965 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:41.528374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b004ff-5c1e-4778-a40f-a4160f692965 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.528653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b004ff-5c1e-4778-a40f-a4160f692965 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.528928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89b004ff-5c1e-4778-a40f-a4160f692965 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.530161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b004ff-5c1e-4778-a40f-a4160f692965 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:41.533776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89b004ff-5c1e-4778-a40f-a4160f692965 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:41.534120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 78/154] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:41 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:41.543135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:41.681595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d1d674-885c-4b02-a683-e2b958f1ca9c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:41.704869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:41.717074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:41.717733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.724080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.724080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.724326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd059c4-6b3f-4530-8463-93024461886d None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.724326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd059c4-6b3f-4530-8463-93024461886d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.724326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd059c4-6b3f-4530-8463-93024461886d None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.724326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 79/155] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:41.729554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:41.729844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:41.730146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:41.759094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:41.760306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:41.762522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:41.837620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:41.839702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:41.932437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 80/156] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:41.993322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.021603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 77/157] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 479 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:42.037929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.085181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:42.136700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccb9ac5-25eb-4537-a53b-347b677dcd29 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.172297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dfc89f-10e9-4b99-ad61-3bdc5093bd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.173333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfc89f-10e9-4b99-ad61-3bdc5093bd0d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.173757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfc89f-10e9-4b99-ad61-3bdc5093bd0d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.174744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dfc89f-10e9-4b99-ad61-3bdc5093bd0d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.182106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:42.186113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dfc89f-10e9-4b99-ad61-3bdc5093bd0d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-49dfc89f-10e9-4b99-ad61-3bdc5093bd0d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:42.194536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:42.199816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 81/158] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 203 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:42.200595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a78d-5d08-428d-aac1-82a2ade9ed03 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.201358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a78d-5d08-428d-aac1-82a2ade9ed03 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.201358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7f7a78d-5d08-428d-aac1-82a2ade9ed03 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.201358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 82/159] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:42.203214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a78d-5d08-428d-aac1-82a2ade9ed03 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.253341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb4e384-f86d-42e1-b70d-7cdd7c9137fe None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.317448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7f7a78d-5d08-428d-aac1-82a2ade9ed03 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.353556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.354785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.355282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.355753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.356702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:42.357261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:42.359107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60524137-834c-4418-ae68-bf5372d1a66e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:42.370166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 83/160] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:42.370297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.371082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.371372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.371703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.372381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.372870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.372970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:42.373456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.374732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:42.376657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 78/161] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:42 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 339 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:42.382612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.392113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:42.393578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:42.462382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:42.469783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 84/162] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:42.485137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.554393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:42.577615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e74cb2f2-fb24-4873-8aa6-dbda6cfbf6cb None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.582131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e191aee9-88a9-41b6-adcd-98b89f54fa6a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.620007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.621036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.621521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.622013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.623243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] RBAC: Adding query filter params (role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=7d464cf1e672441c9fee71e315390413) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:42.623769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:42.625420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:42.632492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 85/163] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:42 2022] GET /identity/v3/role_assignments?user.id=7d464cf1e672441c9fee71e315390413&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:42.633775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.683988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.684504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.684727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.685002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] PATH_INFO: `/v3/users/861320b46d7645f3b4d8d49005174ddc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.694598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] RBAC: Authorizing `identity:get_user(user_id=861320b46d7645f3b4d8d49005174ddc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:42.694598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:42.694598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 79/164] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:42 2022] GET /identity/v3/users/861320b46d7645f3b4d8d49005174ddc => generated 247 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:42.699671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:42.714395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:42.843785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f1d6188-68d5-4cac-8522-c260b4b5241a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.863625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df5f6ab-7a4d-4ea5-b0dd-34d08340d9ad None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:42.909713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.910752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:42.911040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:42.911323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:42.950516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:42.989481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:42.991123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:42.997278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2687e23-de25-4bfc-b013-7f1a9d6af739 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:42.998117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687e23-de25-4bfc-b013-7f1a9d6af739 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.001961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687e23-de25-4bfc-b013-7f1a9d6af739 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.001961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2687e23-de25-4bfc-b013-7f1a9d6af739 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.035940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2687e23-de25-4bfc-b013-7f1a9d6af739 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-b2687e23-de25-4bfc-b013-7f1a9d6af739 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:43.045056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:43.045909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:43.046900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:43.047963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 86/165] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 415 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:43.054164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d838c-0dbb-4a86-afe9-ba3abd9f0a16 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.054454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d838c-0dbb-4a86-afe9-ba3abd9f0a16 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.054737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63d838c-0dbb-4a86-afe9-ba3abd9f0a16 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.056520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 87/166] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:43 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:43.062926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.063213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.063496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.088321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:43.088321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:43.178056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 88/167] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:43.183508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.237680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 80/168] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 538 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:43.243403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.253954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:43.324495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55454cda-7a99-4ff3-af43-bac9b760fa35 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:43.353028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:43.377780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:43.378852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.379366 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.379829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.380780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:43.381275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:43.383231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:43.401033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 89/169] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:43.402221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.433862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75827f5d-878f-4541-b51a-639d25e82500 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:43.506351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:43.507845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.508616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.510110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.511700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:43.514585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:43.516849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 81/170] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:43.522472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.568437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47c180-3de2-4a5b-adb6-bcc933d45df2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:43.579525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:43.610095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21a286eb-8119-4f39-af06-cd4b93105f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:43.611559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a286eb-8119-4f39-af06-cd4b93105f35 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.611851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a286eb-8119-4f39-af06-cd4b93105f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.612137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a286eb-8119-4f39-af06-cd4b93105f35 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.627972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21a286eb-8119-4f39-af06-cd4b93105f35 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-21a286eb-8119-4f39-af06-cd4b93105f35 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:43.639371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:43.640275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:43.641071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 90/171] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:43.642233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f058-f9ee-4b99-9dc8-f89cca1fbfe9 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.642326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f058-f9ee-4b99-9dc8-f89cca1fbfe9 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.643121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69c4f058-f9ee-4b99-9dc8-f89cca1fbfe9 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.645808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 91/172] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:43 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:43.646736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f058-f9ee-4b99-9dc8-f89cca1fbfe9 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.655949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b1a8493-30b7-4468-b321-b7b2093dfc84 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:43.690869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:43.701857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:43.703514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.704040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.704871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] PATH_INFO: `/v3/users/cffd9a89d03f426c964a2a582c645fae` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.706582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] RBAC: Authorizing `identity:get_user(user_id=cffd9a89d03f426c964a2a582c645fae)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:43.708891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:43.714154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 82/173] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/users/cffd9a89d03f426c964a2a582c645fae => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:43.714154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.778192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69c4f058-f9ee-4b99-9dc8-f89cca1fbfe9 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:43.813060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:43.813719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.813992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.814294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.815755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=861320b46d7645f3b4d8d49005174ddc) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:43.816063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:43.817489 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ff990a9-9c91-4ae8-afb4-9e04c4a51fa5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:43.830041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 92/174] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/role_assignments?user.id=861320b46d7645f3b4d8d49005174ddc&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:43.830041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e38dc-4a34-4bb4-969c-01c00f089719 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.830041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e38dc-4a34-4bb4-969c-01c00f089719 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.830041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-195e38dc-4a34-4bb4-969c-01c00f089719 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.848411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-195e38dc-4a34-4bb4-969c-01c00f089719 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:43.849740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-195e38dc-4a34-4bb4-969c-01c00f089719 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:43.850250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06647c64-349c-49f2-8b6c-a9a80f788f92 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:43.881853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:43.892711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:43.893537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.894069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.894356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.895254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:43.895566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:43.897003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:43.906469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 83/175] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:43.907465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.935923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 93/176] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:43.937582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f848-1600-49f8-9a3c-3390d8ccdc03 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.937867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f848-1600-49f8-9a3c-3390d8ccdc03 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.938168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a212f848-1600-49f8-9a3c-3390d8ccdc03 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.940226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 94/177] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:43.941190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260323-36dd-4bf2-8a46-e457446cefa7 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:43.941374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260323-36dd-4bf2-8a46-e457446cefa7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:43.941642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7260323-36dd-4bf2-8a46-e457446cefa7 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:43.946070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 95/178] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:43 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:43.946070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7260323-36dd-4bf2-8a46-e457446cefa7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:43.983081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.039603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8b0abe-18d4-4b73-8957-d79e5efdc4d9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.064383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7260323-36dd-4bf2-8a46-e457446cefa7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.077634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7878eed-423b-4c5f-9ae5-f13f25afd8ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.078570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878eed-423b-4c5f-9ae5-f13f25afd8ef None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.078855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878eed-423b-4c5f-9ae5-f13f25afd8ef None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.079132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7878eed-423b-4c5f-9ae5-f13f25afd8ef None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.080344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7878eed-423b-4c5f-9ae5-f13f25afd8ef None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.081808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7878eed-423b-4c5f-9ae5-f13f25afd8ef None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.083616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 84/179] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:44.083616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.083616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.083616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.101460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:44.102665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:44.103208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ba70171-07e5-4021-bece-b0353b9a3296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.104082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70171-07e5-4021-bece-b0353b9a3296 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.104364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70171-07e5-4021-bece-b0353b9a3296 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.104642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ba70171-07e5-4021-bece-b0353b9a3296 None admin] PATH_INFO: `/v3/users/7d464cf1e672441c9fee71e315390413` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.105826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba70171-07e5-4021-bece-b0353b9a3296 None admin] RBAC: Authorizing `identity:get_user(user_id=7d464cf1e672441c9fee71e315390413)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.107330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ba70171-07e5-4021-bece-b0353b9a3296 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.108975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 96/180] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:43 2022] GET /identity/v3/users/7d464cf1e672441c9fee71e315390413 => generated 275 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:44.110122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.110409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.110688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.126848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:44.128024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:44.150331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.168189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 85/181] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:44.170127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.195180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 97/182] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:44.196050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.231159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.275092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa3e92e-9f6d-45e1-b8f2-18e4216eba38 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.293958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-380c459a-d475-408d-a6ca-c00acd3bff4d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.308599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.309390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.309675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.309955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.320257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:44.327259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:44.327895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:44.328758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:44.329547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:44.330195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.330195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.330195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/cffd9a89d03f426c964a2a582c645fae/roles/b0ae3f6fe25548e09f0335aa34585ca1` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.330873 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 86/183] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:44.330969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a4ead08b54228b90c614639eb6dcf, user_id=cffd9a89d03f426c964a2a582c645fae, role_id=b0ae3f6fe25548e09f0335aa34585ca1)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.331255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.332060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.397432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 98/184] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:44 2022] PUT /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/users/cffd9a89d03f426c964a2a582c645fae/roles/b0ae3f6fe25548e09f0335aa34585ca1 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:56:44.398264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.418577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.438724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-553388cd-cf86-464f-85bf-058a48e5db23 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.455879 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.477764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.478492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.478783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.479066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.519280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf971ad0-ee4e-4ce4-b937-3f99b430c420 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.560872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.562476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.569762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.570618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.570899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.571176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.572368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.574016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.575852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 99/185] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:44.576445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.669593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 87/186] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:44.670102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.670462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.686708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.691261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b45df36-ca0c-4b2b-a530-fd7caa7e4f98 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.729167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.730413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.730860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.731155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.742991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:44.751633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:44.753142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 100/187] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:56:44 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:44.758618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.781245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac1d2502-40c3-47ae-b96a-2a581fa210d6 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.840393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.841063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.841347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.841626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.842431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:44.842744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.844124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.857653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 88/188] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:44.857653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:44.914541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dcbb02-a546-434a-8399-035ff23f158f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.937587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:44.952477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.954634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.954634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.954634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:44.954634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:44.956000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:44.960668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93de1e48-1190-4b8e-97c1-a05f656be4da None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:44.998254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:44.999117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:44.999433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:44.999710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] PATH_INFO: `/v3/projects/2205467d618b47d983fcaca570b1aa54` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.000900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] RBAC: Authorizing `identity:get_project(project_id=2205467d618b47d983fcaca570b1aa54)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.002418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.009129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 89/189] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:44 2022] GET /identity/v3/projects/2205467d618b47d983fcaca570b1aa54 => generated 312 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:45.009129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.069325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 101/190] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:44 2022] POST /identity/v3/users => generated 297 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:45.070290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.073428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.115587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c4f801b-bebe-497e-99b4-591a0f40d693 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.158708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.159399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.159698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.160061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.161141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:45.161465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.162961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.173089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 90/191] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:45.174685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.188251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.229553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3ef074-dcc4-4a87-966e-e20165c8a108 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.274242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.275643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.275933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.276213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] PATH_INFO: `/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.295324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] RBAC: Authorizing `identity:get_user(user_id=5fe6bb31767a4fd9a86929ff91f72c0f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.296785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.298548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 102/192] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f => generated 283 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:45.299338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.307077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018d2ff5-7fd2-4d04-ad58-b23f72ffc9b4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.355704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.356370 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.356661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.356940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.357779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=2205467d618b47d983fcaca570b1aa54, user.id=7d464cf1e672441c9fee71e315390413) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:45.358165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.359582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.367889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 91/193] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/role_assignments?user.id=7d464cf1e672441c9fee71e315390413&scope.project.id=2205467d618b47d983fcaca570b1aa54&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 608 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:45.368990 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.384839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.443365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd8be20-06e4-4df1-94bb-083ed25e880f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.474075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.503642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.504620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.504968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.505313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] PATH_INFO: `/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.507046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe6bb31767a4fd9a86929ff91f72c0f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.508922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.511185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 103/194] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f => generated 283 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:45.517549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.524260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6840ca8-e2e0-4480-8117-cb53ad3e1440 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.584212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.585154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.585588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.586050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.670681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e7e795-1221-4076-a1fd-41380ce0e593 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.671937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.673477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.704459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.712772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.713545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.713905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.714346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.762603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.797115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 92/195] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 428 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:45.800351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.801991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.803485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.914309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 104/196] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 397 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:45.920113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459ce6e3-e0fc-4984-a723-2da4fd98c1cb None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:45.922345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:45.978417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:45.990945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:45.991817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:45.992106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:45.992429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:45.993614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:45.995968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:45.997998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 93/197] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:46.004185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:46.050574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:46.099586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ddb1738-1ea9-4d7e-8479-70442c0f38c8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:46.127621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07a8c039-4e46-440b-9735-d103d13caddd None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:46.163149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:46.164128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:46.164414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:46.164785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:46.165235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:46.165890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:46.166200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:46.166475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:46.167310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=5fe6bb31767a4fd9a86929ff91f72c0f) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:46.167611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:46.169066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e962a93-4a68-4373-a338-f02b32ac0aae None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:46.169349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:46.170894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:46.173005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 105/198] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:45 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:46.175187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 94/199] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:46 2022] GET /identity/v3/role_assignments?user.id=5fe6bb31767a4fd9a86929ff91f72c0f&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:46.178654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:46.341829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:46.348704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-276b63de-a200-4a6c-b015-a66c4636a3ba None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:46.399821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:46.400883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:46.401374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:46.401850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:46.402911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] RBAC: Adding query filter params (role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=5fe6bb31767a4fd9a86929ff91f72c0f) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:46.403425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:46.405082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c5e6488-7a17-41a5-a9db-fdb294c3b5e1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:46.414732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 106/200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:46 2022] GET /identity/v3/role_assignments?user.id=5fe6bb31767a4fd9a86929ff91f72c0f&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 259 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:46.583654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d3e4-c206-4c97-a49e-778a91ec282f None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:46.583974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d3e4-c206-4c97-a49e-778a91ec282f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:46.584225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6041d3e4-c206-4c97-a49e-778a91ec282f None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:46.585835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 95/201] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:46.591161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:46.591459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:46.591743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:46.619061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:46.620294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:46.709468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 107/202] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:46.751771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d3e4-c206-4c97-a49e-778a91ec282f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:46.929179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6041d3e4-c206-4c97-a49e-778a91ec282f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:46.934063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:46.984088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:46.985140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:46.985571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:46.985997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:47.007114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:47.015202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:47.016259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:47.017242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:47.019621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 96/203] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:46 2022] GET /identity/v3/roles/reader => generated 84 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:47.025075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:47.146622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:47.156162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d64a3dd-ed8d-412a-8316-e6c2b068ed0c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:47.198057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:47.199332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:47.199823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:47.200299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:47.201292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:47.201816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:47.203444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:47.217404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 108/204] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:47.223417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:47.370846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2879f8-dbf8-4252-905b-82ceb1c02a94 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:47.421486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-facae18b-8e32-48dd-9561-e4226349f0f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:47.422433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae18b-8e32-48dd-9561-e4226349f0f7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:47.422768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae18b-8e32-48dd-9561-e4226349f0f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:47.423053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-facae18b-8e32-48dd-9561-e4226349f0f7 None admin] PATH_INFO: `/v3/users/cffd9a89d03f426c964a2a582c645fae` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:47.426168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae18b-8e32-48dd-9561-e4226349f0f7 None admin] RBAC: Authorizing `identity:get_user(user_id=cffd9a89d03f426c964a2a582c645fae)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:47.427693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-facae18b-8e32-48dd-9561-e4226349f0f7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:47.429336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 97/205] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:47 2022] GET /identity/v3/users/cffd9a89d03f426c964a2a582c645fae => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:47.434818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:47.573521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b4d6fd-54c7-4c93-b6a3-0d3356448888 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:47.614806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:47.615460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:47.615741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:47.616015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:47.646409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:47.705633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:47.707170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:47.874747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21385515-cc37-4eee-bcf1-eadd8b27e5f8 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:47.875096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21385515-cc37-4eee-bcf1-eadd8b27e5f8 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:47.875307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21385515-cc37-4eee-bcf1-eadd8b27e5f8 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:47.877756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 98/206] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:47.883095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:47.883380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:47.883655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:47.897455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 109/207] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:47.901230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:47.902592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:47.903344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:47.928053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:47.973268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 99/208] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:47.996276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.023294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.096247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a65ad3c-14ae-459e-a741-e21cd8a01645 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.119230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e6be34-7c17-4c0c-b09c-02d0fa9623fa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.131667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9824160-cd36-42b0-bbed-b4b3dda12bc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.132641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824160-cd36-42b0-bbed-b4b3dda12bc8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.133084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824160-cd36-42b0-bbed-b4b3dda12bc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.133495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9824160-cd36-42b0-bbed-b4b3dda12bc8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.143952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9824160-cd36-42b0-bbed-b4b3dda12bc8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-c9824160-cd36-42b0-bbed-b4b3dda12bc8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:48.151981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:48.152919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:48.153712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:48.160745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 100/209] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:47 2022] GET /identity/v3/roles/member => generated 84 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:48.160745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612e5de-222e-4949-bc6c-dcbc5c97dbad None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.160745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612e5de-222e-4949-bc6c-dcbc5c97dbad None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.160745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5612e5de-222e-4949-bc6c-dcbc5c97dbad None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.160745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 101/210] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:48.166816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612e5de-222e-4949-bc6c-dcbc5c97dbad None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.167759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c560035-156e-41f4-a155-503a0aafefce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.168625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560035-156e-41f4-a155-503a0aafefce None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.168902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560035-156e-41f4-a155-503a0aafefce None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.169177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c560035-156e-41f4-a155-503a0aafefce None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.170690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c560035-156e-41f4-a155-503a0aafefce None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.172127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c560035-156e-41f4-a155-503a0aafefce None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:48.174420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 110/211] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:47 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:48.175531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.175924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.176200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.193338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:48.194667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:48.198476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.276223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 111/212] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:48.277511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.315700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5612e5de-222e-4949-bc6c-dcbc5c97dbad None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.342508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.354366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.355360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.355843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.357087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.357339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:48.357828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.359454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:48.373795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 102/213] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:48.375019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.396898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae65092-bd78-492c-8613-da78c551ef7e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.433807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.434554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.434774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.435049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.435883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] RBAC: Adding query filter params (role.id=b0ae3f6fe25548e09f0335aa34585ca1, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf, user.id=cffd9a89d03f426c964a2a582c645fae) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:48.436193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.437632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:48.444606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 112/214] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:48 2022] GET /identity/v3/role_assignments?user.id=cffd9a89d03f426c964a2a582c645fae&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=b0ae3f6fe25548e09f0335aa34585ca1 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:48.445507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.467007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.490127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb5ed2a-3361-4239-abe6-a35dfb022025 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.529168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.530402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.530918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.531391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.532963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.534999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:48.537030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 103/215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:48 2022] GET /identity/v3/domains/default => generated 199 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:48.549746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.664193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db9fd6be-77ca-45ba-8de9-0b12d735a0aa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.664840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbeb1c92-c363-48b5-9e0b-f366c2cf5f9d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.685607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.711364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd2a46d0-bf5d-4034-a438-843d6efcd785 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.711591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.712184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a46d0-bf5d-4034-a438-843d6efcd785 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.712363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.712458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a46d0-bf5d-4034-a438-843d6efcd785 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.712638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.712747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd2a46d0-bf5d-4034-a438-843d6efcd785 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.712961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] PATH_INFO: `/v3/users/f29bf68ba1c144e5bf155cf0839f58a4` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.713448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a46d0-bf5d-4034-a438-843d6efcd785 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.714976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd2a46d0-bf5d-4034-a438-843d6efcd785 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:48.730306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=f29bf68ba1c144e5bf155cf0839f58a4)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.731858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:48.733794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 113/216] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:48 2022] GET /identity/v3/users/f29bf68ba1c144e5bf155cf0839f58a4 => generated 297 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:48.739667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.834408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 104/217] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:48 2022] POST /identity/v3/users => generated 297 bytes in 286 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:48.836000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db206-50de-4ecc-ab84-964ab8791aea None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.836296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db206-50de-4ecc-ab84-964ab8791aea None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.836574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6db206-50de-4ecc-ab84-964ab8791aea None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.837991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 105/218] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:48.844124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.844427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.844695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.857795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.865443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:48.867095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:48.867895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b409814-3582-4aeb-8347-fd23195eb5e9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:48.910159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14994625-adf3-404b-ac47-645e24215295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:48.910827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14994625-adf3-404b-ac47-645e24215295 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:48.911161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14994625-adf3-404b-ac47-645e24215295 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:48.911537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14994625-adf3-404b-ac47-645e24215295 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:48.949898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 106/219] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:48.958817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:48.976302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:48.988682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14994625-adf3-404b-ac47-645e24215295 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:48.990225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14994625-adf3-404b-ac47-645e24215295 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.112738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 114/220] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:56:49.118673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148392a-af85-4399-b2fd-391241672e03 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.118961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148392a-af85-4399-b2fd-391241672e03 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.119242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4148392a-af85-4399-b2fd-391241672e03 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.120624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 115/221] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:49 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:49.121026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3208b1ea-1393-4a1a-93e7-d1d9b30d0036 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.122748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148392a-af85-4399-b2fd-391241672e03 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.165926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adab3d28-8d98-474c-a4d3-a71bf6452a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.166868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3d28-8d98-474c-a4d3-a71bf6452a95 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.167151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3d28-8d98-474c-a4d3-a71bf6452a95 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.168192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adab3d28-8d98-474c-a4d3-a71bf6452a95 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.170564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:49.180035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adab3d28-8d98-474c-a4d3-a71bf6452a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-adab3d28-8d98-474c-a4d3-a71bf6452a95 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:49.188215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:49.189078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:49.189938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 107/222] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:49.190781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.192648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.192648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.211705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:49.212813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:49.214092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:49.254317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4148392a-af85-4399-b2fd-391241672e03 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.284790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 108/223] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:49.290861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.306612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.307488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.307768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.308045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.311141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:49.312903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.315909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 116/224] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:49.316916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.410656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7444197-78b5-4e44-9b4c-3a5466f17f1d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.438909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:49.448379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.449305 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.449812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.450238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.451080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:49.451481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:49.453055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.460534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e7d24a-a269-4707-a0db-1d0b6c8c5b24 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.462536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 109/225] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:49.467632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.506896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.508729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.509092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.509436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.519599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:49.524101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:49.533818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:49.534760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:49.535526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 117/226] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:49.538763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.600543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc49619c-aae1-4a2b-ad65-2b97586f6212 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.645976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.646663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.646945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.647232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.648629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=f29bf68ba1c144e5bf155cf0839f58a4) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:49.649043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:49.650766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.657155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2572851f-9145-4b53-aa7d-5b6275cf13a8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.658318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 110/227] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/role_assignments?user.id=f29bf68ba1c144e5bf155cf0839f58a4&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 259 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:49.659492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.697048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.698911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.699417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.700031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] PATH_INFO: `/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.702130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe6bb31767a4fd9a86929ff91f72c0f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:49.704076 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.707164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 118/228] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f => generated 283 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:49.719371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.750425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:49.846416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:49.856112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed399fb-be0f-4214-a969-53bfd49b45b4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.882592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-103f231e-5e90-4d75-8d2e-32d710c6b9c2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:49.916864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.917538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.917823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.918131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.918893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:49.919202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:49.920581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.936088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 111/229] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:49.937144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:49.938014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:49.938325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:49.938608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:49.940372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:49.941843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:49.943575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 119/230] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:49.944486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:49.949020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:50.058883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e666253-01e5-4965-915e-c8156f1f5560 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:50.096105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:50.097004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:50.097353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:50.097636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/5fe6bb31767a4fd9a86929ff91f72c0f/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:50.106016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] RBAC: Authorizing `identity:create_grant(project_id=679d80d3975f4cfcb02f743c95035e05, user_id=5fe6bb31767a4fd9a86929ff91f72c0f, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:50.107494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:50.114358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:50.169674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bccd5c1-1a8d-488c-adae-6da4c4fb578f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:50.199874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 120/231] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:49 2022] PUT /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/5fe6bb31767a4fd9a86929ff91f72c0f/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:56:50.208255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:50.219808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:50.221314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:50.221604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:50.221881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] PATH_INFO: `/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:50.225169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe6bb31767a4fd9a86929ff91f72c0f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:50.226824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:50.228884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 112/232] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:49 2022] GET /identity/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f => generated 283 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:50.234802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:50.380876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65586dac-f36c-48db-8bb3-ceb6780c32ca None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:50.417638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d84e3fe-e538-425f-a7e4-e31aec95fd42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:50.418881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e3fe-e538-425f-a7e4-e31aec95fd42 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:50.419411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e3fe-e538-425f-a7e4-e31aec95fd42 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:50.419887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d84e3fe-e538-425f-a7e4-e31aec95fd42 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:50.421448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e3fe-e538-425f-a7e4-e31aec95fd42 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:50.423125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d84e3fe-e538-425f-a7e4-e31aec95fd42 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:50.425641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 121/233] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:50 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:50.431526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:50.539572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8596c8-64af-406a-869e-fc4d98c97202 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:50.588824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92c0f3d4-8df2-4fba-bbec-3f3c365219d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:50.589782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f3d4-8df2-4fba-bbec-3f3c365219d7 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:50.590095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f3d4-8df2-4fba-bbec-3f3c365219d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:50.590380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92c0f3d4-8df2-4fba-bbec-3f3c365219d7 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/5fe6bb31767a4fd9a86929ff91f72c0f/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:50.592627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f3d4-8df2-4fba-bbec-3f3c365219d7 None admin] RBAC: Authorizing `identity:create_grant(project_id=679d80d3975f4cfcb02f743c95035e05, user_id=5fe6bb31767a4fd9a86929ff91f72c0f, role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:50.594114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92c0f3d4-8df2-4fba-bbec-3f3c365219d7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:50.730104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 113/234] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:50 2022] PUT /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/5fe6bb31767a4fd9a86929ff91f72c0f/roles/f63a187bba4e41e586f5700d586f8a89 => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:56:51.258774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be8c9-dcf4-40f4-8bad-a80295578985 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.259324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be8c9-dcf4-40f4-8bad-a80295578985 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.259324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b63be8c9-dcf4-40f4-8bad-a80295578985 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:51.260929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 122/235] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:51.266212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48815b-bc11-4ab8-aab7-2971707c294b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.266618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48815b-bc11-4ab8-aab7-2971707c294b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.266783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb48815b-bc11-4ab8-aab7-2971707c294b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:51.283429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-bb48815b-bc11-4ab8-aab7-2971707c294b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:51.284603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bb48815b-bc11-4ab8-aab7-2971707c294b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:51.337785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:51.380084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 114/236] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:51.419811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be8c9-dcf4-40f4-8bad-a80295578985 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:51.420493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057daf0-7722-4c1f-b8a2-66a7e35e9bd0 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.422974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057daf0-7722-4c1f-b8a2-66a7e35e9bd0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.423263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3057daf0-7722-4c1f-b8a2-66a7e35e9bd0 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:51.425493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 115/237] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:51.437489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.437776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.438072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:51.471048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:51.472560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:51.506083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:51.580477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b63be8c9-dcf4-40f4-8bad-a80295578985 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:51.627687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:51.628492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.628775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.629051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:51.633619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 116/238] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:51.651096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:51.659494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:51.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:51.661432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 123/239] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:51 2022] GET /identity/v3/roles/reader => generated 84 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:51.666581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:51.722642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:51.836701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fd9a22-6814-4baf-99ed-92a8390001e7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:51.838223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:51.881908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:51.882606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.882889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.883168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:51.883922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:51.884227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:51.885653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:51.903220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 117/240] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:51 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:51.908505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:51.915128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695820dc-58c4-4423-a2a1-ced0191e8108 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:51.980571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:51.997568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:51.998452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:51.998741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:51.999018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.003440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:52.004901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:52.009015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 124/241] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:51 2022] GET /identity/v3/domains/default => generated 199 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:52.013731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.081546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7dcca5f-23a6-4ee7-a86c-0ae292529708 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.118390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2bc86c-76cf-461a-a455-11bceacce709 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:52.119195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bc86c-76cf-461a-a455-11bceacce709 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.119474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bc86c-76cf-461a-a455-11bceacce709 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.119753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2bc86c-76cf-461a-a455-11bceacce709 None admin] PATH_INFO: `/v3/users/52ca1b5437dd4138969f3742a608fa00` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.134762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bc86c-76cf-461a-a455-11bceacce709 None admin] RBAC: Authorizing `identity:get_user(user_id=52ca1b5437dd4138969f3742a608fa00)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:52.136238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2bc86c-76cf-461a-a455-11bceacce709 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:52.138102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 118/242] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:51 2022] GET /identity/v3/users/52ca1b5437dd4138969f3742a608fa00 => generated 297 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:52.141644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe8dc6-6085-4c52-ba17-03822f7e0d3d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.142165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe8dc6-6085-4c52-ba17-03822f7e0d3d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.142710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09fe8dc6-6085-4c52-ba17-03822f7e0d3d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.144520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 119/243] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:52 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:52.145408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe8dc6-6085-4c52-ba17-03822f7e0d3d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.153252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b12318-bf67-4620-a30c-181642a7b6f9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.175372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:52.190637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a61a7b7-2eda-40a2-981e-b600017c7bb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:52.191375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a7b7-2eda-40a2-981e-b600017c7bb0 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.191656 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a7b7-2eda-40a2-981e-b600017c7bb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.208399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a61a7b7-2eda-40a2-981e-b600017c7bb0 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.208399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a7b7-2eda-40a2-981e-b600017c7bb0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:52.208399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a61a7b7-2eda-40a2-981e-b600017c7bb0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:52.260570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09fe8dc6-6085-4c52-ba17-03822f7e0d3d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.290109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 125/244] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:52 2022] POST /identity/v3/users => generated 293 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:56:52.292172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223607d-6945-403d-9751-5f801641071b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.292677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223607d-6945-403d-9751-5f801641071b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.293116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9223607d-6945-403d-9751-5f801641071b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.312702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a9cb81d-5968-4a22-bdd2-0086fb60a496 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:52.314055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb81d-5968-4a22-bdd2-0086fb60a496 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.315143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb81d-5968-4a22-bdd2-0086fb60a496 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.316436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a9cb81d-5968-4a22-bdd2-0086fb60a496 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.333375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9223607d-6945-403d-9751-5f801641071b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:52.334995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9223607d-6945-403d-9751-5f801641071b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:52.385675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:52.430180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 126/245] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:52.461857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cb81d-5968-4a22-bdd2-0086fb60a496 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:52.463683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a9cb81d-5968-4a22-bdd2-0086fb60a496 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:52.473988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223607d-6945-403d-9751-5f801641071b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.507919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:52.625385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9223607d-6945-403d-9751-5f801641071b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.629130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 120/246] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 484 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:52.630746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ab2e-20b5-4ae7-ac40-6f1aa9d69412 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.631248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ab2e-20b5-4ae7-ac40-6f1aa9d69412 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.632705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f12ab2e-20b5-4ae7-ac40-6f1aa9d69412 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.634289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 121/247] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:52.635222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ab2e-20b5-4ae7-ac40-6f1aa9d69412 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.671467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ae25b7-aa43-404c-be90-db47d59b9657 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:52.672689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae25b7-aa43-404c-be90-db47d59b9657 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.673276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae25b7-aa43-404c-be90-db47d59b9657 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.674378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ae25b7-aa43-404c-be90-db47d59b9657 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.686745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ae25b7-aa43-404c-be90-db47d59b9657 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-90ae25b7-aa43-404c-be90-db47d59b9657 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:52.695405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:52.696371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:52.697170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:52.699979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 127/248] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:52.701404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.701909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.703660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.725479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:52.727093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:52.761500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f12ab2e-20b5-4ae7-ac40-6f1aa9d69412 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.764860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:52.797129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:52.810426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:52.811474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.811881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.812259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.813443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:52.813732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 128/249] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:52.814942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.815057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:52.816849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 122/250] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:52 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:52.822800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.920337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fee68bc-c902-4553-8c50-13ab9b2a7aca None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.952972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72b75bc3-eb34-4e0f-89f4-1c17a4dbae08 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:52.955494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:52.956170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:52.956511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:52.956786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:52.957591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] RBAC: Adding query filter params (name=member) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:52.957901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:52.959337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:52.968246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 129/251] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:52.968848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:52.999741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.000402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.000957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.001240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.002137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] RBAC: Adding query filter params (role.id=b0ae3f6fe25548e09f0335aa34585ca1, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=52ca1b5437dd4138969f3742a608fa00) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:53.002710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:53.004848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:53.005923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:53.013819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 123/252] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:52 2022] GET /identity/v3/role_assignments?user.id=52ca1b5437dd4138969f3742a608fa00&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=b0ae3f6fe25548e09f0335aa34585ca1 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:53.014988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:53.119703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:53.127350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9410cc9d-cc97-4e60-854c-2744c9c3b1bb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:53.218371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d464216-b670-407d-a600-1595401c8eb0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:53.232520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.233389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.233673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.234004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.259787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:53.264600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.265473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.265750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.266063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] PATH_INFO: `/v3/users/f29bf68ba1c144e5bf155cf0839f58a4` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:53.271356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:53.272222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:53.272998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 130/253] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:56:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 304 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:53.273631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] RBAC: Authorizing `identity:get_user(user_id=f29bf68ba1c144e5bf155cf0839f58a4)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:53.275140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:53.276657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 124/254] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:53 2022] GET /identity/v3/users/f29bf68ba1c144e5bf155cf0839f58a4 => generated 297 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:53.281829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:53.283469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:53.389399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:53.400446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27343041-cc0d-442c-9d9d-2d344f302a7e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:53.442886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.443577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.443865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.444143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.446055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:53.446055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:53.447208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f2fb0b1-0749-4cbb-bb4a-19916d72be63 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:53.457564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 131/255] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:53.458692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ac5f-7fdb-40f9-a0ed-34d93423d50e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.458986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ac5f-7fdb-40f9-a0ed-34d93423d50e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.459266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d964ac5f-7fdb-40f9-a0ed-34d93423d50e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.460648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 132/256] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:53.465595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ac5f-7fdb-40f9-a0ed-34d93423d50e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:53.513808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9abdc7b-442e-42f0-9e77-b9c4fc242fae None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:53.558643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:53.576211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9347ce36-388f-47af-815f-bf4ebebd4fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.577085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ce36-388f-47af-815f-bf4ebebd4fbe None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.577364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ce36-388f-47af-815f-bf4ebebd4fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.577635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9347ce36-388f-47af-815f-bf4ebebd4fbe None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.581470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347ce36-388f-47af-815f-bf4ebebd4fbe None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:53.582983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9347ce36-388f-47af-815f-bf4ebebd4fbe None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:53.589853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 125/257] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:53 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:53.592634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.593889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.594194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.614935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:53.616405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:53.681148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d964ac5f-7fdb-40f9-a0ed-34d93423d50e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:53.732708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.733589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.733872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.739033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] PATH_INFO: `/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.739033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe6bb31767a4fd9a86929ff91f72c0f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:53.739033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:53.739543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 133/258] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:53 2022] GET /identity/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f => generated 283 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:53.740408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:53.746309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 126/259] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:53.747270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:53.786488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:53.919377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-947f4ba6-307d-4b8e-b446-e8ef985fb5f4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:53.955031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:53.956185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:53.956467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:53.956742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/f29bf68ba1c144e5bf155cf0839f58a4/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:53.958873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] RBAC: Authorizing `identity:create_grant(project_id=679d80d3975f4cfcb02f743c95035e05, user_id=f29bf68ba1c144e5bf155cf0839f58a4, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:53.960719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:53.978020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf62a6b-8ef3-4e47-9c5a-48a022f5becd None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:54.000988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:54.014240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:54.014956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:54.015237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:54.015512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:54.046870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 134/260] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:53 2022] PUT /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/f29bf68ba1c144e5bf155cf0839f58a4/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:56:54.047629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:54.149763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:54.153126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:54.178692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:54.223830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18e93ecc-3f34-42ec-85d7-d82b4f42861b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:54.282506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:54.283960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:54.284239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:54.284518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:54.305321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 127/261] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 558 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:54.311322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:54.313646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:54.321942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:54.322856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:56:54.323667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:54.324268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 135/262] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:56:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 277 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:54.330437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:54.352430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:54.456797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86adae3-d71b-4079-aab1-0181603ac208 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:54.494478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:54.495539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:54.495821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:54.496097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:54.496849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:54.497154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:54.499196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:54.508557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 136/263] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:56:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:54.514690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:54.518086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:54.536198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-431c2b61-7f23-4098-85b0-e68412bc6724 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:54.624601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce447362-e5fa-466d-9ff2-656d8a10a678 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:54.661200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:54.662109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:54.662398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:54.662734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] PATH_INFO: `/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:54.663979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] RBAC: Authorizing `identity:get_user(user_id=5fe6bb31767a4fd9a86929ff91f72c0f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:54.665534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:54.670137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 137/264] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:54 2022] GET /identity/v3/users/5fe6bb31767a4fd9a86929ff91f72c0f => generated 283 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:54.672863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:54.674528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:54.675410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:54.675694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:54.675970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:54.677184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:54.678678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:54.680663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 128/265] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:54 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:54.686875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:54.762447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:54.781939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7c0276-e723-4250-afe2-728f23311c41 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:54.863723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:54.864387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:54.864673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:54.864952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:54.903052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:54.921516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efdef39c-fb58-457e-8e0b-a1414b40524c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:55.012338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:55.013811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:55.016085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:55.017018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.017587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.018090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.019110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=5fe6bb31767a4fd9a86929ff91f72c0f) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:55.019598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:55.021212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:55.033623 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 129/266] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:54 2022] GET /identity/v3/role_assignments?user.id=5fe6bb31767a4fd9a86929ff91f72c0f&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:55.088111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:55.133482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 138/267] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 461 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:56:55.138284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:55.262157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a07934-8eba-43ca-bcdf-0b6f22bbde5d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:55.305588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39b90329-61a3-418e-a4e8-2b01d196cc35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:55.306829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b90329-61a3-418e-a4e8-2b01d196cc35 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.307339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b90329-61a3-418e-a4e8-2b01d196cc35 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.307832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39b90329-61a3-418e-a4e8-2b01d196cc35 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.315529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b90329-61a3-418e-a4e8-2b01d196cc35 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:55.317327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39b90329-61a3-418e-a4e8-2b01d196cc35 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:55.319696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 130/268] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:55 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:55.325176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:55.449267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f28d8a3-c32e-4386-b301-2549d31ec48e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:55.477759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60b9c-84ac-473f-862f-edaea6f7ba96 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.478083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60b9c-84ac-473f-862f-edaea6f7ba96 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.478596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c60b9c-84ac-473f-862f-edaea6f7ba96 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.480414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 131/269] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:55.486849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30900238-459e-4727-a150-f9ba54e37811 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.487407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30900238-459e-4727-a150-f9ba54e37811 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.487878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30900238-459e-4727-a150-f9ba54e37811 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.491262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:55.491920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.492199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.492469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.493301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] RBAC: Adding query filter params (role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=5fe6bb31767a4fd9a86929ff91f72c0f) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:55.493611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:55.495077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f9a05a3-5f4b-4647-bd85-a117b6fc70b7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:55.502115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 139/270] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:55 2022] GET /identity/v3/role_assignments?user.id=5fe6bb31767a4fd9a86929ff91f72c0f&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:55.507908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-30900238-459e-4727-a150-f9ba54e37811 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:55.509399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-30900238-459e-4727-a150-f9ba54e37811 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:55.526316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:55.540722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72053e8-a0f3-4b4b-a64c-d9787350947e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.541020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72053e8-a0f3-4b4b-a64c-d9787350947e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.541314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b72053e8-a0f3-4b4b-a64c-d9787350947e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.542804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 140/271] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:55.555953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609cf3f-6013-4ef3-8d87-9310d89dd3bc None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.556626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609cf3f-6013-4ef3-8d87-9310d89dd3bc None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.556626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a609cf3f-6013-4ef3-8d87-9310d89dd3bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.575800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a609cf3f-6013-4ef3-8d87-9310d89dd3bc None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:55.577085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a609cf3f-6013-4ef3-8d87-9310d89dd3bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:55.630014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:55.642994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 132/272] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:55.700133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 141/273] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:55.702008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30900238-459e-4727-a150-f9ba54e37811 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:55.719988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee552-78b2-4337-9aad-8df37785b331 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.720271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee552-78b2-4337-9aad-8df37785b331 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.721103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16ee552-78b2-4337-9aad-8df37785b331 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.722583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 142/274] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:56:55.729172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.729457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.729734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.749019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:55.750236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:55.832889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30900238-459e-4727-a150-f9ba54e37811 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:55.834868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 143/275] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:55.836015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:55.893173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:55.894401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.894684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:55.894958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:55.905925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:55.914063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:55.914991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:55.915792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 133/276] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:55 2022] GET /identity/v3/roles/reader => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:55.920684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:55.933337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:55.953272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:55.960776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-229ed28f-ca12-4ce5-8cb4-12a18e64b036 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:55.997810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:55.999121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:55.999874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.000493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.001998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.003615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.005395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 144/277] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:55 2022] GET /identity/v3/domains/default => generated 199 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:56.005967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.028131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d4656f-64ab-48ab-9c79-e53d0d50525b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.066622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.067416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.067703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.067983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.078842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:56.087219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:56.088089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 134/278] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:56.089978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.116437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec013d4f-c6f5-4e56-b7f4-3d4894d3acf2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.154093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.154756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.155036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.155308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.156049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:56.156350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.157996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.160835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:56.170513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 145/279] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:56.170513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.194727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb420c-2fb7-447b-8519-f3332e657fa6 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.197456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:56.228204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.228868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.229149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.229424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.230150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.231595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.274968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a307199a-7f0d-4072-9c22-887221592dd9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.308334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.308997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.309276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.309600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.310406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] RBAC: Adding query filter params (name=member) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:56.310708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.312141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.320797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 146/280] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:56.325407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.346173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 135/281] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:56:56 2022] POST /identity/v3/users => generated 293 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:56.346173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.421721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:56.445760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb52ac-3d9e-4d04-9c25-5bbac5a47d46 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.483894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.484777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.485060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.485333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] PATH_INFO: `/v3/users/52ca1b5437dd4138969f3742a608fa00` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.487265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] RBAC: Authorizing `identity:get_user(user_id=52ca1b5437dd4138969f3742a608fa00)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.488818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.490891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 147/282] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/users/52ca1b5437dd4138969f3742a608fa00 => generated 297 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:56.496344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.513277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5d2211a-aa29-48d9-bebd-97286fbe6843 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.557057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:56.571079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.571969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.572250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.572526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] PATH_INFO: `/v3/users/ad08e32898e8415197d0013f9237c4f3` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.588295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] RBAC: Authorizing `identity:get_user(user_id=ad08e32898e8415197d0013f9237c4f3)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.589787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.592271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 136/283] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/users/ad08e32898e8415197d0013f9237c4f3 => generated 293 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:56.598906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.638614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6b99a47-d3ed-4b74-b799-1bb209a22b57 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.682383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.683246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.683517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.683796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.686630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.688083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.690731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 148/284] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:56.696043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.719880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82e4250f-a709-461d-ad38-53c9fad16f65 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.728348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:56.770801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.771808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.772102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.772657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.773710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, user.id=ad08e32898e8415197d0013f9237c4f3, scope.system=all) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:56.774062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.776101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a30420-ae99-4b88-aa87-380f89c31112 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.783057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 137/285] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/role_assignments?user.id=ad08e32898e8415197d0013f9237c4f3&scope.system=all&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 226 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:56.784641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442b9b8-896b-4785-b368-a275aca01620 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.784934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442b9b8-896b-4785-b368-a275aca01620 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.785216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4442b9b8-896b-4785-b368-a275aca01620 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.787909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 138/286] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:56.794358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.794667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.794926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.818917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:56.820455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:56.838733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c0aa170-62fa-4e35-87da-0762db8fc6c6 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:56.880130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:56.881705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:56.882224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:56.882715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/52ca1b5437dd4138969f3742a608fa00/roles/b0ae3f6fe25548e09f0335aa34585ca1` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:56.885048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] RBAC: Authorizing `identity:create_grant(project_id=679d80d3975f4cfcb02f743c95035e05, user_id=52ca1b5437dd4138969f3742a608fa00, role_id=b0ae3f6fe25548e09f0335aa34585ca1)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:56.886591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:56.887066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:56.926311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 139/287] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:56.946929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:56.974422 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 149/288] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:56:56 2022] PUT /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05/users/52ca1b5437dd4138969f3742a608fa00/roles/b0ae3f6fe25548e09f0335aa34585ca1 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:56:57.109003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2915d251-e52c-4a3a-b70d-11f8f3c50a31 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:57.156747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:57.157481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:57.157765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:57.158684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:57.173274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:57.181699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:57.182603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:57.183391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:57.184849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 140/289] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:56 2022] GET /identity/v3/roles/member => generated 84 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:57.191154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:57.281239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:57.303108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30b162d-4a1d-46e4-9ae0-5973acc868d3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:57.357367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:57.358061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:57.358349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:57.358626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:57.359435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] RBAC: Adding query filter params (name=member) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:57.360174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:57.361901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:57.374118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 150/290] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:57 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:57.379745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:57.452855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:57.540788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08b50889-da06-43bd-8aa0-a77fd6c36110 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:57.588542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:57.589419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:57.589705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:57.589982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] PATH_INFO: `/v3/users/f29bf68ba1c144e5bf155cf0839f58a4` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:57.591227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] RBAC: Authorizing `identity:get_user(user_id=f29bf68ba1c144e5bf155cf0839f58a4)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:57.592676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:57.594633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 141/291] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:57 2022] GET /identity/v3/users/f29bf68ba1c144e5bf155cf0839f58a4 => generated 297 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:57.600046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:57.718013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d731d7-0290-4ede-b397-31512375db7c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:57.751466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:57.752645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:57.752922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:57.753244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:57.768850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:57.821283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:57.822828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:57.931259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 151/292] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:56:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:56:57.937066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:58.071869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de327a5-acc2-410d-8ad9-9dd597b23108 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:58.079816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:58.114116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6ca780-dcbb-4b6f-8fb4-ddcc31bb3acd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:58.114991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ca780-dcbb-4b6f-8fb4-ddcc31bb3acd None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:58.115273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ca780-dcbb-4b6f-8fb4-ddcc31bb3acd None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:58.115547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6ca780-dcbb-4b6f-8fb4-ddcc31bb3acd None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:58.116735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ca780-dcbb-4b6f-8fb4-ddcc31bb3acd None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:58.118191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6ca780-dcbb-4b6f-8fb4-ddcc31bb3acd None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:58.120239 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 142/293] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:56:57 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:58.127683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:58.200002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:58.261693 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886e69bf-822c-4cae-a3e3-58648c513984 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:58.309724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:58.310546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:58.310831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:58.311104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:58.311949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=f29bf68ba1c144e5bf155cf0839f58a4) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:58.312257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:58.313698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ac1a67-3a27-4057-89e0-0153e1aba25e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:58.324315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 152/294] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:56:58 2022] GET /identity/v3/role_assignments?user.id=f29bf68ba1c144e5bf155cf0839f58a4&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:59.041678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7a8ea-9526-46b3-af0a-c8506873a171 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.042737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7a8ea-9526-46b3-af0a-c8506873a171 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.043021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f7a8ea-9526-46b3-af0a-c8506873a171 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.044549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 143/295] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:59.050002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.050503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.050582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.070642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:59.071835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:59.076578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8aed-bf8d-49a1-bbed-9da130b9f8f7 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.076871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8aed-bf8d-49a1-bbed-9da130b9f8f7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.077151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1f8aed-bf8d-49a1-bbed-9da130b9f8f7 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.078833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 144/296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:59.084644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.084931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.085207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.105409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:59.106604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:59.153817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 153/297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:59.181447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.181624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 145/298] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:56:59.205682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.225956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:59.303809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf5f4ec-d4dd-4280-bb73-1be67701da33 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.317546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f479589-7b2a-4fcd-9acf-70f39ad0216b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.320057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:59.341677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fd60e9-0ed3-48e1-9aeb-f4253caaaf7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.342971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd60e9-0ed3-48e1-9aeb-f4253caaaf7d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.343429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd60e9-0ed3-48e1-9aeb-f4253caaaf7d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.343880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fd60e9-0ed3-48e1-9aeb-f4253caaaf7d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.345189 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd60e9-0ed3-48e1-9aeb-f4253caaaf7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:59.347004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52fd60e9-0ed3-48e1-9aeb-f4253caaaf7d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:59.349220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 154/299] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:56:59.350676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804eaf2-3244-441c-9328-ccff875be244 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.351118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804eaf2-3244-441c-9328-ccff875be244 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.351544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6804eaf2-3244-441c-9328-ccff875be244 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.352883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 155/300] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:59.356909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168f64ec-a5cb-4175-949c-adf4f264f9f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.357327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804eaf2-3244-441c-9328-ccff875be244 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.357703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f64ec-a5cb-4175-949c-adf4f264f9f1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.357981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f64ec-a5cb-4175-949c-adf4f264f9f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.358304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168f64ec-a5cb-4175-949c-adf4f264f9f1 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.369312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168f64ec-a5cb-4175-949c-adf4f264f9f1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-168f64ec-a5cb-4175-949c-adf4f264f9f1 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:59.377553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:59.378459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:56:59.379268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 146/301] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:56:59.380482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.380482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.380482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.399386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:59.400564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:59.466790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6804eaf2-3244-441c-9328-ccff875be244 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.474092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 147/302] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:59.474092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.478497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:59.508648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.509805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.510355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.511141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] PATH_INFO: `/v3/groups` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.512604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:59.514078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:59.569833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:59.576154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84b520a-a7ae-4bfc-aaff-cbba4cc6fecd None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.588633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 156/303] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Jul 6 16:56:59 2022] POST /identity/v3/groups => generated 229 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:56:59.589454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.610376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.611644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.611936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.612208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.612986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:59.613293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:59.614767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30661c6c-fb80-4dd7-8c11-0d7951c12b33 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:59.624221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 148/304] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:59.630959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb72e-cab6-4825-a749-1efa87e2e86c None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.631526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb72e-cab6-4825-a749-1efa87e2e86c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.631766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7fcb72e-cab6-4825-a749-1efa87e2e86c None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.634079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 149/305] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:56:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:56:59.634079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcb72e-cab6-4825-a749-1efa87e2e86c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.722777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05d1d64-cfd9-4896-852f-5618eca5bd24 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.744612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7fcb72e-cab6-4825-a749-1efa87e2e86c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.762480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898c25f8-4903-42ee-8c79-9cdcea00d656 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.763231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c25f8-4903-42ee-8c79-9cdcea00d656 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.763510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c25f8-4903-42ee-8c79-9cdcea00d656 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.763781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898c25f8-4903-42ee-8c79-9cdcea00d656 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.776257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898c25f8-4903-42ee-8c79-9cdcea00d656 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-898c25f8-4903-42ee-8c79-9cdcea00d656 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:56:59.784032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:56:59.784952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:56:59.785725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 157/306] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:56:59.787025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.787025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.787177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.789384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.790375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.790661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.790939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] PATH_INFO: `/v3/users/27badd4b41394667a61e3ae8bac42c54` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.804520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:56:59.805697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:56:59.806306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] RBAC: Authorizing `identity:get_user(user_id=27badd4b41394667a61e3ae8bac42c54)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:59.807771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:59.809671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 150/307] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/users/27badd4b41394667a61e3ae8bac42c54 => generated 293 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:59.813507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.829150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:59.830244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:56:59.877094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 158/308] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:56:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:56:59.878260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.925403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561ce7e2-b680-44ee-92c5-81fb6f4e39ed None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:56:59.959865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:56:59.960532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:56:59.960812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:56:59.961086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:56:59.961829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:56:59.962162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:56:59.963555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:56:59.972622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 151/309] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:56:59.977976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:56:59.991924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e794cc7-d4a5-4d98-a3e9-9a937cdce632 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.031165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.031817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.032365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.032365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.033704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] RBAC: Adding query filter params (role.id=b0ae3f6fe25548e09f0335aa34585ca1, user.id=27badd4b41394667a61e3ae8bac42c54, scope.system=all) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:00.034012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:00.035472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:00.050067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 159/310] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/role_assignments?user.id=27badd4b41394667a61e3ae8bac42c54&scope.system=all&role.id=b0ae3f6fe25548e09f0335aa34585ca1 => generated 226 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:00.050067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:00.069526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:00.075254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:00.105911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa7323e8-4777-4bc1-b931-fdadcf13d074 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.157566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30ea8489-21c5-49f8-83ed-1291672cbf7b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.160332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.162185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.162473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.162752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.178069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:00.188556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:00.190169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:57:00.190955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:00.194183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 152/311] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:56:59 2022] GET /identity/v3/roles/reader => generated 84 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:00.196896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:00.206608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.207541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.207853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.208132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] PATH_INFO: `/v3/users/ad08e32898e8415197d0013f9237c4f3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.209343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] RBAC: Authorizing `identity:get_user(user_id=ad08e32898e8415197d0013f9237c4f3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:00.210935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:00.212813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 160/312] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:57:00 2022] GET /identity/v3/users/ad08e32898e8415197d0013f9237c4f3 => generated 293 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:00.218830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:00.325903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1438e609-38ce-4254-8e59-be2fca564c6a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.334525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:00.352023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce00c6ec-6842-4500-b618-81f7c3a66035 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.373326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.374370 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.374858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.375351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.377376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:00.378186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:00.380416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:00.384476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:00.391549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.392624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.398337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.398337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] PATH_INFO: `/v3/system/users/ad08e32898e8415197d0013f9237c4f3/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.398505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 153/313] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:00 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:00.398578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=ad08e32898e8415197d0013f9237c4f3, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:00.398578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:00.398904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:00.461890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 161/314] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 6 16:57:00 2022] PUT /identity/v3/system/users/ad08e32898e8415197d0013f9237c4f3/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:57:00.524729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb1b3ee-71a1-4709-9c8b-0a26217de751 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.563527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.564982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.565263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.565536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] PATH_INFO: `/v3/users/52ca1b5437dd4138969f3742a608fa00` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.566860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] RBAC: Authorizing `identity:get_user(user_id=52ca1b5437dd4138969f3742a608fa00)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:00.568332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:00.570354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 154/315] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:57:00 2022] GET /identity/v3/users/52ca1b5437dd4138969f3742a608fa00 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:00.575901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:00.689951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc64ccd-bac3-43ef-8e35-37a13d36e988 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:00.726000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:00.727007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:00.727495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:00.727948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:00.755574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:00.804807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:00.806930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:00.910761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 162/316] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:00 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 335 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:00.916246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:00.981448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:01.016588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaf71dd-f5d1-4754-abb3-a813f5f0b51f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:01.051091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb86d57-6610-45e0-b5b7-f180cb047b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:01.051948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb86d57-6610-45e0-b5b7-f180cb047b33 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:01.052234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb86d57-6610-45e0-b5b7-f180cb047b33 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:01.052513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb86d57-6610-45e0-b5b7-f180cb047b33 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:01.053687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb86d57-6610-45e0-b5b7-f180cb047b33 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:01.055169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb86d57-6610-45e0-b5b7-f180cb047b33 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:01.057161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 155/317] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:00 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:01.062768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:01.117145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:01.165425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42252eec-d24c-469f-8102-33d956472cbb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:01.202013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:01.202692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:01.202965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:01.203251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:01.204089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] RBAC: Adding query filter params (role.id=b0ae3f6fe25548e09f0335aa34585ca1, scope.project.id=679d80d3975f4cfcb02f743c95035e05, user.id=52ca1b5437dd4138969f3742a608fa00) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:01.204403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:01.205875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f84918f-fe36-4a15-86d2-adf59d96e12c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:01.212275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 163/318] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:01 2022] GET /identity/v3/role_assignments?user.id=52ca1b5437dd4138969f3742a608fa00&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=b0ae3f6fe25548e09f0335aa34585ca1 => generated 608 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:01.714796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c77e3-4ac9-40f1-9ab2-3bc5b357e6a2 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:01.715292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c77e3-4ac9-40f1-9ab2-3bc5b357e6a2 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:01.715366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71c77e3-4ac9-40f1-9ab2-3bc5b357e6a2 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:01.716732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 156/319] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:01.722589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:01.722881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:01.723157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:01.740199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:01.741372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:01.808722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 164/320] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:01.831127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c77e3-4ac9-40f1-9ab2-3bc5b357e6a2 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:01.932210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71c77e3-4ac9-40f1-9ab2-3bc5b357e6a2 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:01.965604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca08212e-b374-4499-89bd-17c8794cf83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:01.966414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08212e-b374-4499-89bd-17c8794cf83f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:01.966694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08212e-b374-4499-89bd-17c8794cf83f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:01.966963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca08212e-b374-4499-89bd-17c8794cf83f None admin] PATH_INFO: `/v3/domains/default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:01.968169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08212e-b374-4499-89bd-17c8794cf83f None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:01.969600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca08212e-b374-4499-89bd-17c8794cf83f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:01.971406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 157/321] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:01.976667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:02.023311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:02.080487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d5ef7f-ec33-4c75-9958-963101307945 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:02.114357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:02.115019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.115299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.115574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] PATH_INFO: `/v3/groups` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.116322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:02.117754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:02.169677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d19a1-7487-4583-83fb-0ba51fcf04fe None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.169968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d19a1-7487-4583-83fb-0ba51fcf04fe None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.170294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-229d19a1-7487-4583-83fb-0ba51fcf04fe None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.171695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 158/322] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:57:02.177032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.177381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.177726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.182759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:02.194598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:02.195785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:02.217431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 165/323] 10.222.0.20 () {60 vars in 1134 bytes} [Wed Jul 6 16:57:01 2022] POST /identity/v3/groups => generated 226 bytes in 241 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:02.270084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 159/324] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:02.289056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:02.399471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-376e76d0-b887-4b62-ade7-f0f8fcd6e9d3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:02.406862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:02.434212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59a6709c-9dc8-481d-8fe8-40b0cc0507bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:02.435040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6709c-9dc8-481d-8fe8-40b0cc0507bd None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.435368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6709c-9dc8-481d-8fe8-40b0cc0507bd None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.435601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59a6709c-9dc8-481d-8fe8-40b0cc0507bd None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.446949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59a6709c-9dc8-481d-8fe8-40b0cc0507bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-59a6709c-9dc8-481d-8fe8-40b0cc0507bd None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:02.455587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:02.456473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:02.457258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 166/325] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:02 2022] GET /identity/v3/roles/reader => generated 84 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:02.464287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:02.509340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197da33-e8f2-46f9-a13e-f4f3a9555dfa None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.509629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197da33-e8f2-46f9-a13e-f4f3a9555dfa None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.509908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4197da33-e8f2-46f9-a13e-f4f3a9555dfa None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.511661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 167/326] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:02.516668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.517001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.517770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.539727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:02.540940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:02.588302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48ad262-3479-4fbe-9917-9956df2f471e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:02.633780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:02.639614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 168/327] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:02.640224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:02.641154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.641438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.641713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.643052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:02.643425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:02.651380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:02.654094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 160/328] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:02 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:02.659882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:02.663763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:02.852813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:02.859484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd465f1-1a59-47f4-8c67-74752407c96f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:02.862714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e407719-8211-4b91-b4d4-237682e3e8d4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:02.901857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:02.901857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.902195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.902266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.917710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:02.925249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:02.926158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:02.926442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:02.926716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] PATH_INFO: `/v3/users/27badd4b41394667a61e3ae8bac42c54` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:02.927929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] RBAC: Authorizing `identity:get_user(user_id=27badd4b41394667a61e3ae8bac42c54)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:02.929378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:02.931045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 169/329] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:57:02 2022] GET /identity/v3/users/27badd4b41394667a61e3ae8bac42c54 => generated 293 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:02.932993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:02.933848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:02.934770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 161/330] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:02 2022] GET /identity/v3/roles/member => generated 84 bytes in 271 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:02.939535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:02.947071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:03.053403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d83c16-58c2-46d4-8f43-a706f4876a9c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:03.082393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:03.094173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:03.095053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:03.095503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:03.096986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] PATH_INFO: `/v3/system/users/27badd4b41394667a61e3ae8bac42c54/roles/b0ae3f6fe25548e09f0335aa34585ca1` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:03.099224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=27badd4b41394667a61e3ae8bac42c54, role_id=b0ae3f6fe25548e09f0335aa34585ca1)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:03.100612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:03.146394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b6c3cb2-1e2a-49c0-a589-9da2467f21e7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:03.183970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 170/331] 10.222.0.20 () {58 vars in 1334 bytes} [Wed Jul 6 16:57:02 2022] PUT /identity/v3/system/users/27badd4b41394667a61e3ae8bac42c54/roles/b0ae3f6fe25548e09f0335aa34585ca1 => generated 0 bytes in 245 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:03.185059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:03.185787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:03.186196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:03.186521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:03.187247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:03.187624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:03.189788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:03.201401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 162/332] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:02 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:03.207430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:03.243369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:03.326302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0f43f51-daf8-412c-a589-f6915a9d2183 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:03.364360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02d2e84-bb63-4d20-94d6-56412c7a1ed7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:03.365252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d2e84-bb63-4d20-94d6-56412c7a1ed7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:03.365536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d2e84-bb63-4d20-94d6-56412c7a1ed7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:03.365815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02d2e84-bb63-4d20-94d6-56412c7a1ed7 None admin] PATH_INFO: `/v3/users/ad08e32898e8415197d0013f9237c4f3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:03.367074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d2e84-bb63-4d20-94d6-56412c7a1ed7 None admin] RBAC: Authorizing `identity:get_user(user_id=ad08e32898e8415197d0013f9237c4f3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:03.368527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d02d2e84-bb63-4d20-94d6-56412c7a1ed7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:03.370418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 171/333] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:57:03 2022] GET /identity/v3/users/ad08e32898e8415197d0013f9237c4f3 => generated 293 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:03.376164 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:03.490886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255277f2-7d55-4039-b3e3-4f0bfe685ea1 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:03.512643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:03.548267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:03.549528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:03.549813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:03.550171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:03.551023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] RBAC: Adding query filter params (role.id=bdf6277a543a4a4796fbbdb19658a494, user.id=ad08e32898e8415197d0013f9237c4f3, scope.system=all) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:03.551339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:03.552790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74166b69-85d2-474c-93bb-4b234c1d5324 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:03.571439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 163/334] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 6 16:57:03 2022] GET /identity/v3/role_assignments?user.id=ad08e32898e8415197d0013f9237c4f3&scope.system=all&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 510 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:04.763777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96999c8e-92dc-44cf-a0d2-6da496de088c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:04.764269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96999c8e-92dc-44cf-a0d2-6da496de088c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:04.764366 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96999c8e-92dc-44cf-a0d2-6da496de088c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:04.765984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 172/335] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:04.771171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:04.771571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:04.771756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:04.795052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:04.796250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:04.876351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 164/336] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:04.918138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96999c8e-92dc-44cf-a0d2-6da496de088c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:05.027694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:05.035561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96999c8e-92dc-44cf-a0d2-6da496de088c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:05.073110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:05.073913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:05.074220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:05.074495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:05.091531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:05.100039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:05.100903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:05.101685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 173/337] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:04 2022] GET /identity/v3/roles/member => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:05.108173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:05.229784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cb539f0-de3e-4e85-8a19-1149ee3e983c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:05.238366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:05.273236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:05.273921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:05.274238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:05.274517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:05.275279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:05.275585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:05.277149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:05.292896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 165/338] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:05 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:05.299248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:05.425912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19b76b57-fc4a-4601-908c-d6c43749fce3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:05.466447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8ed2d83-7e3f-4b7b-af23-92231b0ee2bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:05.467105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2d83-7e3f-4b7b-af23-92231b0ee2bf None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:05.467390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2d83-7e3f-4b7b-af23-92231b0ee2bf None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:05.467673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8ed2d83-7e3f-4b7b-af23-92231b0ee2bf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:05.499340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:05.547014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2d83-7e3f-4b7b-af23-92231b0ee2bf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:05.549039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8ed2d83-7e3f-4b7b-af23-92231b0ee2bf None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:05.666918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 174/339] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:05 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:05.672877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:05.717949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c13330-c734-4491-b5a9-a74e3a260e3b None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:05.718632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c13330-c734-4491-b5a9-a74e3a260e3b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:05.719132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c13330-c734-4491-b5a9-a74e3a260e3b None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:05.720953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 175/340] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:05.726556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:05.727096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:05.727557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:05.757386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:05.758300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:05.840450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c44e4d12-a0c2-467c-b26a-6bd338570a3a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:05.847342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:05.869132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 176/341] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:05.905200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:05.906375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:05.906932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:05.907435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:05.909372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:05.911073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:05.913210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 166/342] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:05 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:05.918519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:05.922431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:05.973862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:06.111783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4cfd95-fdf9-4c5d-890d-45d5012a6af4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:06.112808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5578ee4-fc34-4418-a04e-262647052ea2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:06.166091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:06.166958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.167238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.167510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.182792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:06.184041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5954c55-5695-45e2-bc3e-484cfc447468 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:06.184259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:06.185222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954c55-5695-45e2-bc3e-484cfc447468 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.185654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954c55-5695-45e2-bc3e-484cfc447468 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.186096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5954c55-5695-45e2-bc3e-484cfc447468 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.186378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 177/343] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:05 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:06.192394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:06.201806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5954c55-5695-45e2-bc3e-484cfc447468 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-e5954c55-5695-45e2-bc3e-484cfc447468 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:06.213822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:06.214945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:06.215933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:06.218272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 167/344] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:06.219788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763df8-d164-4d87-89a9-c8e23005ff94 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.220867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763df8-d164-4d87-89a9-c8e23005ff94 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.221327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f763df8-d164-4d87-89a9-c8e23005ff94 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.222827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 168/345] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:06.226865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763df8-d164-4d87-89a9-c8e23005ff94 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:06.290211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:06.355849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:06.359743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df7ecbdd-daad-48ef-a507-1cb86936e3de None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:06.366724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f763df8-d164-4d87-89a9-c8e23005ff94 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:06.403899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:06.404615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.404904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.405181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.406013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:06.406343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:06.408337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43d829a9-d9c4-48ee-b22d-13082771d4c3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:06.417277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:06.417946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.418254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.418533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.419314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:06.419624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:06.420987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4ea7363-98f7-42c3-80c0-ddcd9c4ac350 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:06.425265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 178/346] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:06 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 260 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:06.426864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.427407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.427948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.438593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 169/347] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:06 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:06.439989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8cb4-407a-4f93-ad76-c8efc8684319 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.440282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8cb4-407a-4f93-ad76-c8efc8684319 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.440561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567f8cb4-407a-4f93-ad76-c8efc8684319 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.441785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 170/348] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:06.448424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.448732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.449012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.453103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:06.455449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:06.499217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:06.500436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:06.548685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 179/349] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:06.549965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:06.621561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:06.686049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8708e54c-9628-4d57-98c1-fb055224b38d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:06.688253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 171/350] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 241 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:06.690481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:06.726983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:06.728008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.728474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.728891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.782082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:06.798520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0eebf984-b508-435d-ba9d-dd0121d18e7d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:06.804282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:06.806122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:06.836666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146bac4a-a3d6-42d5-a584-7a8ae71d97d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:06.837740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bac4a-a3d6-42d5-a584-7a8ae71d97d5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.838114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bac4a-a3d6-42d5-a584-7a8ae71d97d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.838489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146bac4a-a3d6-42d5-a584-7a8ae71d97d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.849308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146bac4a-a3d6-42d5-a584-7a8ae71d97d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:06.856887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-146bac4a-a3d6-42d5-a584-7a8ae71d97d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:06.858749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:06.859768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:06.860574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:06.861229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 172/351] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:06.862534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7c6a5-5e98-45e5-99f8-14146c585c48 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:06.862920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7c6a5-5e98-45e5-99f8-14146c585c48 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:06.863291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af7c6a5-5e98-45e5-99f8-14146c585c48 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:06.871774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 173/352] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:06.871774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7c6a5-5e98-45e5-99f8-14146c585c48 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:06.922875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 180/353] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:06.924696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:06.982447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af7c6a5-5e98-45e5-99f8-14146c585c48 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.021783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3de6b2-aab6-4884-b39d-93e919aeb4fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.022697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3de6b2-aab6-4884-b39d-93e919aeb4fd None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.023048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3de6b2-aab6-4884-b39d-93e919aeb4fd None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.023388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3de6b2-aab6-4884-b39d-93e919aeb4fd None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.034793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3de6b2-aab6-4884-b39d-93e919aeb4fd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:07.037738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d60b52a-2178-4889-a85b-9d18ff5ea789 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-9b3de6b2-aab6-4884-b39d-93e919aeb4fd None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:07.044302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:07.045201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:07.046010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 174/354] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:06 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:07.046831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.047511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.047884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.060808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.067977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:07.069405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:07.079850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.080793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.081248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.081657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.082576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] RBAC: Adding query filter params (name=member) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:07.083038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.084591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:07.093966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 181/355] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:06 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:07.095060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.104438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.154764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 175/356] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:07.155876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.224572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce1b114-6e55-4a4a-8d1b-6d574a0b2e37 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.273155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27302ae9-e9c6-44ea-8432-84e5cbf6e9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.274882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27302ae9-e9c6-44ea-8432-84e5cbf6e9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.275596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27302ae9-e9c6-44ea-8432-84e5cbf6e9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.276086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27302ae9-e9c6-44ea-8432-84e5cbf6e9e5 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.278205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27302ae9-e9c6-44ea-8432-84e5cbf6e9e5 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.280284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27302ae9-e9c6-44ea-8432-84e5cbf6e9e5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:07.283290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 182/357] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:07.285003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b268e0-e4f5-4f5d-919d-36d7744323ac None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.285476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b268e0-e4f5-4f5d-919d-36d7744323ac None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.285919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17b268e0-e4f5-4f5d-919d-36d7744323ac None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.288187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 183/358] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:07.289100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b268e0-e4f5-4f5d-919d-36d7744323ac None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.289495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f4f31d2-33ff-4ff4-8fa2-60c3a4fa9aae None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.335528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073cfa-185a-4964-9946-32991858075c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.336204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073cfa-185a-4964-9946-32991858075c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.336482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073cfa-185a-4964-9946-32991858075c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.336758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2073cfa-185a-4964-9946-32991858075c None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.337511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073cfa-185a-4964-9946-32991858075c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:07.337816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073cfa-185a-4964-9946-32991858075c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.339260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2073cfa-185a-4964-9946-32991858075c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:07.341583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.352566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 176/359] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:07.355958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073cfa-185a-4964-9946-32991858075c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.396093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.432776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17b268e0-e4f5-4f5d-919d-36d7744323ac None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.477341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89764dfc-7cd9-4a9f-b5e7-0c907de170a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.478252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89764dfc-7cd9-4a9f-b5e7-0c907de170a9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.478649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89764dfc-7cd9-4a9f-b5e7-0c907de170a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.478933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89764dfc-7cd9-4a9f-b5e7-0c907de170a9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.487613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2073cfa-185a-4964-9946-32991858075c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.526676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.527477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.527759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.528039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.542079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:07.548299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:07.549682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:07.550852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 177/360] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:07.551517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.568867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89764dfc-7cd9-4a9f-b5e7-0c907de170a9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.570429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89764dfc-7cd9-4a9f-b5e7-0c907de170a9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:07.624943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.656202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.677770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53dd41a8-5627-4684-9ce0-659fe9cc4fba None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.690547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 184/361] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:07.692000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.692346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.692686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.711093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:07.712569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:07.722489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.723352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.723633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.723914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.726718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.727770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:07.729553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 178/362] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:07.730643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.793944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 185/363] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:07.794707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.861074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826997fd-36a1-4a18-af53-d94ad38383a7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.890478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.902339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.904818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.904818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.904818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.921498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cd24d47-cf7d-4eb4-9837-6e9ad9d66e9d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:07.924795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:07.967541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:07.968125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:07.968412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:07.968688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:07.969434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] RBAC: Adding query filter params (name=reader) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:07.969741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.971715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:07.980026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 186/364] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:07.980836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:07.984812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:07.986750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.101815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 179/365] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:08.102762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.102986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8c7eaf-532a-4360-a755-1e61bfe2414a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.140211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:08.145387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.146277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.146555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.146834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.148988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.150532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.152412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 187/366] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:07 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.153087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.202636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:08.233124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b283ba44-e9d9-4b07-8236-79ee8ffc5cc8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.275226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f52ba901-1440-4a3e-8b7a-adb8d811ce9a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.282158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.283127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.283406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.283678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.284515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:08.284822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.286947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.295519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 180/367] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.298170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.326195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.327525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.328379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.328815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.343320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:08.352966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:08.353979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 188/368] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:08.358907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.424362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:08.441317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ed501bf-debf-4971-82bd-5c90b49d3379 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.477925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:08.486393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0335ba40-6f3d-4e81-9d3c-1e370c973af9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.488622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.490165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.495433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.496056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] PATH_INFO: `/v3/users/27badd4b41394667a61e3ae8bac42c54` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.497997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] RBAC: Authorizing `identity:get_user(user_id=27badd4b41394667a61e3ae8bac42c54)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.499742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.502647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 181/369] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/users/27badd4b41394667a61e3ae8bac42c54 => generated 293 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.503700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.541608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.542852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.543144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.543421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.545079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.549206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.549206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 189/370] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.551226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.660563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3e8a8e-4069-45b7-9c92-7dca11acb986 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.678993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b5540d5-033a-415a-85ed-66f524b241d1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.716793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.718555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.718995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.719418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.721306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.723229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.725993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 182/371] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.727185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.729327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.730150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.730558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.730921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.731769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:08.732819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.733675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.750554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 190/372] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.751994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.763487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:08.791051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:08.853189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01945800-083f-43fd-9af9-b50984e63141 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.889915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2b3179-738a-4abc-8f57-ba966cc159a2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:08.897744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.898434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.898717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.898994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.899836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] RBAC: Adding query filter params (role.id=b0ae3f6fe25548e09f0335aa34585ca1, user.id=27badd4b41394667a61e3ae8bac42c54, scope.system=all) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:08.900148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.901598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.916750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 183/373] 10.222.0.20 () {56 vars in 1308 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/role_assignments?user.id=27badd4b41394667a61e3ae8bac42c54&scope.system=all&role.id=b0ae3f6fe25548e09f0335aa34585ca1 => generated 510 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.917414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:08.930077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cf86f5e-b6ee-4185-8261-8b9169684639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:08.931107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf86f5e-b6ee-4185-8261-8b9169684639 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.931398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf86f5e-b6ee-4185-8261-8b9169684639 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.931726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cf86f5e-b6ee-4185-8261-8b9169684639 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.934206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf86f5e-b6ee-4185-8261-8b9169684639 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:08.935900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cf86f5e-b6ee-4185-8261-8b9169684639 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:08.938128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 191/374] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:08.939887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad805d3-f602-48ab-ae05-4b051bf06a94 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:08.940185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad805d3-f602-48ab-ae05-4b051bf06a94 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:08.940473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad805d3-f602-48ab-ae05-4b051bf06a94 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:08.941769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 192/375] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:08.946775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad805d3-f602-48ab-ae05-4b051bf06a94 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.019781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:09.043674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01e26d3c-8dba-40be-b8dd-427c6db1d0c1 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.085193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:09.096453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.097986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.097986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.100327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.101279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=679d80d3975f4cfcb02f743c95035e05) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:09.101461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad805d3-f602-48ab-ae05-4b051bf06a94 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.101631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:09.103136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:09.111508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 184/376] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 260 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:09.112377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.171101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.172405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.172928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.173967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.237916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b23c0c-ee63-4278-88aa-ef67261663cc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.273166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:09.275187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:09.276021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.276794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.277180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.277564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.278559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=679d80d3975f4cfcb02f743c95035e05) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:09.278975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:09.280541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa2759a4-aea2-42d4-8561-18b68698afb9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:09.289579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 185/377] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 260 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:09.289579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.289579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.289579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.321597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:09.322865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:09.337348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:09.428251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 186/378] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:09.458408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:09.467052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 193/379] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 525 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:09.471282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.479992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.602198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f701a1-9c34-473e-a0a9-9f8d17f34b35 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.610393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f82d4294-cc86-42e8-81ed-252187fa2502 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.641575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.643221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.643644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.644100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.652630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.653797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.654308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.654795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] PATH_INFO: `/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.654897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:09.656286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] RBAC: Authorizing `identity:get_project(project_id=e4521befd6aa4cfbb3b9af1101181f7f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:09.657979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:09.660175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 194/380] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:09.665501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:09.666457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:09.667263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 187/381] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:09.669306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.669550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.672435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:09.766822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:09.832125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbd22e9-acb8-48e7-b524-be4e7ab03ad3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.833369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db0e5588-a75e-4998-895e-7c8ed762e90b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:09.870725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.871818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.872309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.872758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.873801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:09.874308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:09.875943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:09.886423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 188/382] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:09.892754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.910068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:09.911228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:09.913917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:09.914419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] PATH_INFO: `/v3/groups/401ac447274c429b86fce15abbb6c449` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:09.926701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] RBAC: Authorizing `identity:get_group(group_id=401ac447274c429b86fce15abbb6c449)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:09.928218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:09.930271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 195/383] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/groups/401ac447274c429b86fce15abbb6c449 => generated 229 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:09.935799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:09.977232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:10.021395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4b7fbe-8e70-4517-8d02-f8cf9ce3fa9d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:10.059414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:10.060620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:10.061133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:10.061589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:10.063087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:10.065375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:10.067361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 189/384] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:10.075093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:10.111269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13a86b41-1f96-410a-adc8-8d34918984ce None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:10.136862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:10.149374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:10.150190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:10.155982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:10.155982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:10.155982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] RBAC: Adding query filter params (group.id=401ac447274c429b86fce15abbb6c449, role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=e4521befd6aa4cfbb3b9af1101181f7f) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:10.155982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:10.155982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:10.160440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 196/385] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:09 2022] GET /identity/v3/role_assignments?group.id=401ac447274c429b86fce15abbb6c449&scope.project.id=e4521befd6aa4cfbb3b9af1101181f7f&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 260 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:10.229425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3afe6eff-14ad-4694-9b77-6bcc912f8ff3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:10.263626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:10.269261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af85e6ce-4fb6-4715-a75e-c2b1d940abda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:10.270162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e6ce-4fb6-4715-a75e-c2b1d940abda None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:10.270450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e6ce-4fb6-4715-a75e-c2b1d940abda None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:10.270731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af85e6ce-4fb6-4715-a75e-c2b1d940abda None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:10.272056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85e6ce-4fb6-4715-a75e-c2b1d940abda None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:10.273510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af85e6ce-4fb6-4715-a75e-c2b1d940abda None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:10.275542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 190/386] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:10 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:10.281231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:10.398857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d4950-ffa1-418e-83a0-bd3c7ef193f4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:10.437159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46399962-45a0-4547-b047-62b5a92c475b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:10.438138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399962-45a0-4547-b047-62b5a92c475b None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:10.438424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399962-45a0-4547-b047-62b5a92c475b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:10.438701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46399962-45a0-4547-b047-62b5a92c475b None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/groups/26ca192e55164b22b93c29a8b04df8be/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:10.440766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46399962-45a0-4547-b047-62b5a92c475b None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a4ead08b54228b90c614639eb6dcf, group_id=26ca192e55164b22b93c29a8b04df8be, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:10.442251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46399962-45a0-4547-b047-62b5a92c475b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:10.541813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 197/387] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 6 16:57:10 2022] PUT /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/groups/26ca192e55164b22b93c29a8b04df8be/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:10.979570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f210-c10d-419f-953c-d0eb0f40ef74 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:10.980080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f210-c10d-419f-953c-d0eb0f40ef74 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:10.980180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd0f210-c10d-419f-953c-d0eb0f40ef74 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:10.981721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 191/388] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:10.987183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:10.987576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:10.987742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.005525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:11.007006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:11.057605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:11.088848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 198/389] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:11.123275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f210-c10d-419f-953c-d0eb0f40ef74 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:11.264773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd0f210-c10d-419f-953c-d0eb0f40ef74 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:11.315000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:11.316063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.316504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.317196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.330841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:11.338975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:11.339988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:11.340982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:11.343212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 192/390] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:11.348727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:11.487175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e6a97d1-df28-4e04-ac59-c3ee1e8d1b61 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:11.529946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:11.533317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.533317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.533317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.533317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:11.533317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:11.533713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:11.543379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 199/391] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:11.552155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:11.632422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:11.684753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c6729a-5875-478a-a5c3-02ba7feaafcc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:11.719508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b512eaac-7e6d-4661-abe1-0d8cfe444c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:11.720400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512eaac-7e6d-4661-abe1-0d8cfe444c5f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.720689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512eaac-7e6d-4661-abe1-0d8cfe444c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.720953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b512eaac-7e6d-4661-abe1-0d8cfe444c5f None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.722139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512eaac-7e6d-4661-abe1-0d8cfe444c5f None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:11.723575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b512eaac-7e6d-4661-abe1-0d8cfe444c5f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:11.725469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 193/392] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:11 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:11.730859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:11.814857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:11.879121 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d069-33fe-4b29-aa69-986f756892f6 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.879403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d069-33fe-4b29-aa69-986f756892f6 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.879686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0993d069-33fe-4b29-aa69-986f756892f6 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.881570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 194/393] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:11.896907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157597-3143-48ba-a022-a7649ba6aadd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.897195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157597-3143-48ba-a022-a7649ba6aadd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.897371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ce8d632-174d-4e28-b005-79a54a26aa29 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:11.897477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4157597-3143-48ba-a022-a7649ba6aadd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.926462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e4157597-3143-48ba-a022-a7649ba6aadd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:11.927634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e4157597-3143-48ba-a022-a7649ba6aadd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:11.932939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a906751-1006-4d52-a099-e5882c12b88f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:11.933808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906751-1006-4d52-a099-e5882c12b88f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.934136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906751-1006-4d52-a099-e5882c12b88f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.934414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a906751-1006-4d52-a099-e5882c12b88f None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.935767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906751-1006-4d52-a099-e5882c12b88f None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:11.938058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a906751-1006-4d52-a099-e5882c12b88f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:11.940090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 200/394] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:11 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:11.941267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239fbde-5cb8-43af-b427-2055b74527ce None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:11.941555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239fbde-5cb8-43af-b427-2055b74527ce None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:11.941834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d239fbde-5cb8-43af-b427-2055b74527ce None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:11.943530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 201/395] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:11.948267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239fbde-5cb8-43af-b427-2055b74527ce None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.018061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 195/396] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:12.018061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.018061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.018061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.035567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:12.037102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:12.086337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d239fbde-5cb8-43af-b427-2055b74527ce None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.097613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:12.105409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:12.130052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 196/397] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:12.130052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.131952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1525158-2505-4439-806d-966a536dba58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.133051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1525158-2505-4439-806d-966a536dba58 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.133331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1525158-2505-4439-806d-966a536dba58 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.133606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1525158-2505-4439-806d-966a536dba58 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/groups/26ca192e55164b22b93c29a8b04df8be/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.136848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1525158-2505-4439-806d-966a536dba58 None admin] RBAC: Authorizing `identity:create_grant(project_id=ea4a4ead08b54228b90c614639eb6dcf, group_id=26ca192e55164b22b93c29a8b04df8be, role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:12.138561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1525158-2505-4439-806d-966a536dba58 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:12.200197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 202/398] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 6 16:57:11 2022] PUT /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf/groups/26ca192e55164b22b93c29a8b04df8be/roles/f63a187bba4e41e586f5700d586f8a89 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:12.206072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1525158-2505-4439-806d-966a536dba58 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.258284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa9587b0-725d-4204-a354-163dfc0972b9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.309897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.312376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.313838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.314560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] PATH_INFO: `/v3/roles/member` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.327228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:12.336445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:12.337342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:12.338158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:12.340728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 197/399] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/roles/member => generated 84 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:12.353344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.395488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1525158-2505-4439-806d-966a536dba58 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.439197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.440905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:12.441897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.442457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.442878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.458483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:12.473671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:12.474816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:12.475808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:12.479196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 203/400] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:12.485279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.521182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:12.534246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-267d193e-5631-4973-9c21-738c069fd83a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.571523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.572198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.572485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.572767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.573524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:12.573834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:12.575273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:12.585082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 198/401] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:12.593877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.628454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd7f948d-4ac6-499b-be6c-a5d0eb2364fa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.676216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.676985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.677339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.677688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.678553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:12.679093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:12.681047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2ed570-57f5-4352-820d-6e5dc3a218b4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:12.696222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 204/402] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:12.696222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38ff0a-c3b7-4ca7-81d2-2684ec9eb10e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.696222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38ff0a-c3b7-4ca7-81d2-2684ec9eb10e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.696222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce38ff0a-c3b7-4ca7-81d2-2684ec9eb10e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.696222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 205/403] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:12.697431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38ff0a-c3b7-4ca7-81d2-2684ec9eb10e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.722565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1daf8-801a-4a42-b4dc-ae694000565d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.733773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:12.770922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec1be15-67c2-4c83-80ba-63629a41a892 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.772548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1be15-67c2-4c83-80ba-63629a41a892 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.772913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1be15-67c2-4c83-80ba-63629a41a892 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.773348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec1be15-67c2-4c83-80ba-63629a41a892 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.775167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1be15-67c2-4c83-80ba-63629a41a892 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:12.777346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec1be15-67c2-4c83-80ba-63629a41a892 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:12.784353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 199/404] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:12.784353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.784353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.784353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.805317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:12.806894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:12.820666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:12.834786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce38ff0a-c3b7-4ca7-81d2-2684ec9eb10e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:12.874456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:12.875615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:12.876035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:12.877060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:12.878524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:12.880220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:12.887059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 206/405] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:12.887059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.893539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 200/406] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:12.898175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:12.999886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf6dddd-e4a0-4165-b137-ea2705fac906 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.021344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ad0faba-0781-438a-b3d5-ba459546743b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.034750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:13.039220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.040303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.040769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.041475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.042872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.044522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.051666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 207/407] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:13.055081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.062047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.062938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.063224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.063519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.065911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.067881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.074837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 201/408] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:12 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:13.074837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.091710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:13.172770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e41e9511-3de8-4de4-b8de-7d9db36f3004 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.190713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d356d65-79c1-48be-a56b-668c73fed6ff None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.210906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.212110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.212398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.212771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.222898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:13.225409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b9d19f-7591-48b5-a64c-ce3ee004bbe2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.226308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9d19f-7591-48b5-a64c-ce3ee004bbe2 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.226592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9d19f-7591-48b5-a64c-ce3ee004bbe2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.226867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b9d19f-7591-48b5-a64c-ce3ee004bbe2 None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05/groups/26ca192e55164b22b93c29a8b04df8be/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.228779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9d19f-7591-48b5-a64c-ce3ee004bbe2 None admin] RBAC: Authorizing `identity:create_grant(project_id=679d80d3975f4cfcb02f743c95035e05, group_id=26ca192e55164b22b93c29a8b04df8be, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.230230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b9d19f-7591-48b5-a64c-ce3ee004bbe2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:13.230518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:13.231380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:13.232154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 208/409] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:13 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:13.232875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.312832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 202/410] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 6 16:57:13 2022] PUT /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05/groups/26ca192e55164b22b93c29a8b04df8be/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 241 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:13.319403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:13.321636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f6870-2e52-4de3-978e-ef9cab07383f None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.321927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f6870-2e52-4de3-978e-ef9cab07383f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.322579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10f6870-2e52-4de3-978e-ef9cab07383f None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.331967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 203/411] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:13 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:13.332798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f6870-2e52-4de3-978e-ef9cab07383f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.337706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63f87a8-577f-4038-a342-ac3dafc8a9fc None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.376474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8b3042-561a-423a-b9ab-f44c42a6713b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.377633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3042-561a-423a-b9ab-f44c42a6713b None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.383820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3042-561a-423a-b9ab-f44c42a6713b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.383820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8b3042-561a-423a-b9ab-f44c42a6713b None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05/groups/26ca192e55164b22b93c29a8b04df8be/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.384029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:13.384345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3042-561a-423a-b9ab-f44c42a6713b None admin] RBAC: Authorizing `identity:create_grant(project_id=679d80d3975f4cfcb02f743c95035e05, group_id=26ca192e55164b22b93c29a8b04df8be, role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.384345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd8b3042-561a-423a-b9ab-f44c42a6713b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.452321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10f6870-2e52-4de3-978e-ef9cab07383f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.463303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 209/412] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 6 16:57:13 2022] PUT /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05/groups/26ca192e55164b22b93c29a8b04df8be/roles/f63a187bba4e41e586f5700d586f8a89 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:13.465671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.468285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.468285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.491869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:13.493899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:13.503882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.504809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.505926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.506670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.507847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:13.508749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.510887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.523960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 204/413] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:13 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:13.529336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.599569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 210/414] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:13.638180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.692150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:13.695380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a9bc5-c237-4e3c-a61e-abfdc9a6bdf7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.733857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.735019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.735440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.736480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] PATH_INFO: `/v3/groups/401ac447274c429b86fce15abbb6c449` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.737837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] RBAC: Authorizing `identity:get_group(group_id=401ac447274c429b86fce15abbb6c449)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.739884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.745870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:13.746116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 205/415] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:13 2022] GET /identity/v3/groups/401ac447274c429b86fce15abbb6c449 => generated 229 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:13.749114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.777903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886940b9-14d4-4a10-8465-6ce40473c557 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.827428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.829393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.830045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.833004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.844005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:13.852268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:13.853291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:13.854302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:13.856699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 211/416] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:13.875717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:13.897945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-741925a0-6349-434b-8646-c88cc5efc3ee None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:13.934341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:13.935411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:13.935606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:13.935884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] PATH_INFO: `/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:13.939455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] RBAC: Authorizing `identity:get_project(project_id=e4521befd6aa4cfbb3b9af1101181f7f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:13.941027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:13.943092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 206/417] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:13 2022] GET /identity/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f => generated 344 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:13.948632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:14.014073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:14.029238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b345e583-13e2-4aa4-9b27-3c433f02aedb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:14.072313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:14.072979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.073258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.073534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.074311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] RBAC: Adding query filter params (name=member) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:14.074616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:14.078079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:14.084793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:14.109385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 212/418] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:13 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:14.110331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:14.165618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da3bb8-1159-45d2-bf52-6849b4c7ebd3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:14.225154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d621c14-69fc-4fc2-90e7-2d6ae20307f3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:14.227424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:14.228503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.228925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.229346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] PATH_INFO: `/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f/groups/401ac447274c429b86fce15abbb6c449/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.235342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] RBAC: Authorizing `identity:create_grant(project_id=e4521befd6aa4cfbb3b9af1101181f7f, group_id=401ac447274c429b86fce15abbb6c449, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:14.237575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:14.264358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70824d98-8165-4523-8430-3f949c254c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:14.264928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824d98-8165-4523-8430-3f949c254c63 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.265257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824d98-8165-4523-8430-3f949c254c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.265530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70824d98-8165-4523-8430-3f949c254c63 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.340616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 207/419] 10.222.0.20 () {58 vars in 1442 bytes} [Wed Jul 6 16:57:13 2022] PUT /identity/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f/groups/401ac447274c429b86fce15abbb6c449/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 392 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:14.343005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:14.354558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70824d98-8165-4523-8430-3f949c254c63 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:14.356034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70824d98-8165-4523-8430-3f949c254c63 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:14.474865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 213/420] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:14 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 365 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:14.483572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:14.543477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227fe8-5ddf-4d03-96e5-2595c1463828 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.543774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227fe8-5ddf-4d03-96e5-2595c1463828 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.544117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b227fe8-5ddf-4d03-96e5-2595c1463828 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.546384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 214/421] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:57:14.552322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.552857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.553332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.574911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:14.576958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:14.642818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:14.650165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c0bf2b-7d9c-43d6-9a4b-b26e1f70fba2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:14.678683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 215/422] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:14.701791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:14.708553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:14.709547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.709934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.710328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.713480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:14.715093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:14.717229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 208/423] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:14 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:14.724537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:14.733037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:14.816257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cda3637d-0f62-474b-bc9e-8d75b1576569 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:14.884842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:14.885902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:14.886351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:14.886770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:14.904072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:14.913235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:14.914328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:14.915393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:14.925681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 216/424] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:14 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:14.934538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:14.939738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-857ccc58-cb2b-4be1-b8c8-a60245e27225 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:15.012107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:15.012974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.013254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.013528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.019046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:15.020440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:15.022365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 209/425] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:14 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:15.028006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:15.032855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:15.050450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49d8c69-4a3a-4b67-81c8-ff2e9578a0d7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:15.071966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:15.094213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:15.096586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.097801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.098278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.100895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:15.101375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:15.104086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:15.120443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 217/426] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:15.127179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:15.204570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4897449c-9990-4693-bbaf-0e9222dc1b11 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:15.243454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:15.244439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.244945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.245428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.246645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:15.247179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:15.248933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:15.256652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 210/427] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:15 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 611 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:15.358407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24829b-6f80-4084-800b-94e971d89de9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:15.406927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e28a81-e9dd-4f4f-b08a-b11ecdc177a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:15.407640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e28a81-e9dd-4f4f-b08a-b11ecdc177a6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.407922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e28a81-e9dd-4f4f-b08a-b11ecdc177a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.408195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e28a81-e9dd-4f4f-b08a-b11ecdc177a6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.433361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:15.505650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e28a81-e9dd-4f4f-b08a-b11ecdc177a6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:15.507451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e28a81-e9dd-4f4f-b08a-b11ecdc177a6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:15.634479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 218/428] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 509 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:57:15.640208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:15.753610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:15.762190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75a28f94-77c1-4a01-bda7-d9decc0a1b43 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:15.783053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93748c8-e3f9-435b-b863-bf7b342c476c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.783343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93748c8-e3f9-435b-b863-bf7b342c476c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.783620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d93748c8-e3f9-435b-b863-bf7b342c476c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.785228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 219/429] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:15.790809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.791095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.791378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.804274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:15.805500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.806016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:15.806655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] PATH_INFO: `/v3/projects/ea4a4ead08b54228b90c614639eb6dcf` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:15.808193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] RBAC: Authorizing `identity:get_project(project_id=ea4a4ead08b54228b90c614639eb6dcf)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:15.809959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:15.816612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:15.816612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:15.817285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 211/430] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:15 2022] GET /identity/v3/projects/ea4a4ead08b54228b90c614639eb6dcf => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:15.818823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:15.890218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:15.919038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 220/431] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:15.948818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:15.949254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08f89a5c-86ad-41b2-8938-352c28f9d1e3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:15.998786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:15.999656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:15.999937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.000210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.002257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.003582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.010903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 212/432] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:15 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:16.011291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.053419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.090533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e23f9bd-ebc4-45ed-8cd5-d048d913aacb None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.136193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e343803b-70f6-47f9-ad6c-27d8a2112c81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.137055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343803b-70f6-47f9-ad6c-27d8a2112c81 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.137336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343803b-70f6-47f9-ad6c-27d8a2112c81 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.137610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e343803b-70f6-47f9-ad6c-27d8a2112c81 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.152846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-817093e7-185c-4531-afa5-32022ee104bb None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.154659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e343803b-70f6-47f9-ad6c-27d8a2112c81 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e343803b-70f6-47f9-ad6c-27d8a2112c81 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:16.163030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:16.163905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:16.164677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 221/433] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:16.166335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c516c-3add-4e70-b7c9-efe763ec1722 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.166335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c516c-3add-4e70-b7c9-efe763ec1722 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.166543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e50c516c-3add-4e70-b7c9-efe763ec1722 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.168068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 222/434] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:16.172999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.173374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.173659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.190468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:16.191626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:16.196424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.197069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.197354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.197633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.198555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=ea4a4ead08b54228b90c614639eb6dcf) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:16.199282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.201098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.214452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 213/435] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=ea4a4ead08b54228b90c614639eb6dcf&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 611 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:16.216927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.231298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.279841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 223/436] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:16.299442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.358103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.370915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc13d66-0ecb-4a4c-85c6-fd6fcef4afa0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.417273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.417876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.418201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.418485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.419247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] RBAC: Adding query filter params (name=member) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:16.419559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.420976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.423632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8684821d-4f65-4146-8714-9bcb8576b10f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.432050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 214/437] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:16.437087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.464271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.465295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.465403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.465636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.479166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:16.487665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:16.488619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:16.489483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:16.491080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 224/438] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:16.496827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.538514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.568694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-285f4ee2-96c8-4bd7-9bad-f550cf924f20 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.613754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e64fc0-da64-4f8c-8023-0a045e153dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.614575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64fc0-da64-4f8c-8023-0a045e153dea None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.614931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64fc0-da64-4f8c-8023-0a045e153dea None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.615287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e64fc0-da64-4f8c-8023-0a045e153dea None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.637678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866bdb6f-574f-4ee7-9e1a-be1d99a141d6 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.648048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.680535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.681184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.682186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.682473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.683554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:16.683864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.685260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.697066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 225/439] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:16.700517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.708934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e64fc0-da64-4f8c-8023-0a045e153dea None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.710459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e64fc0-da64-4f8c-8023-0a045e153dea None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.812546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 215/440] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:16.817807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.818379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb41b-4b50-4b7e-95f8-1bf6794c9487 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.818379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb41b-4b50-4b7e-95f8-1bf6794c9487 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.818659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270fb41b-4b50-4b7e-95f8-1bf6794c9487 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.819961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 216/441] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:57:16.820714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb41b-4b50-4b7e-95f8-1bf6794c9487 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:16.823088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75443bc0-6491-40d7-b7ed-9c9f630ad621 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.855371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.856019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.856589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.856863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.877661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:16.920472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270fb41b-4b50-4b7e-95f8-1bf6794c9487 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:16.923658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.925106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.954496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7c253f-adbc-4ef0-8870-09536986411d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:16.955282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c253f-adbc-4ef0-8870-09536986411d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.955561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c253f-adbc-4ef0-8870-09536986411d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.955832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7c253f-adbc-4ef0-8870-09536986411d None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.956981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c253f-adbc-4ef0-8870-09536986411d None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:16.958431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7c253f-adbc-4ef0-8870-09536986411d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:16.960085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 217/442] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:16.961184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:16.961465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:16.961737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:16.977136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:16.978333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:17.012293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.021264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 226/443] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:16 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:57:17.027256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.044609 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 218/444] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:17.045466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.104767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.122375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e0e69a6-43bc-416a-aba7-92f0e8712214 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.148711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77c6bca-1c44-43a4-9639-bea800f2f777 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.155510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.156358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.156638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.156913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.158632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.160085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.161696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 227/445] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:17.162467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.182123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.182971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.183252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.183526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] PATH_INFO: `/v3/projects/679d80d3975f4cfcb02f743c95035e05` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.184686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] RBAC: Authorizing `identity:get_project(project_id=679d80d3975f4cfcb02f743c95035e05)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.186175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.187875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 219/446] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/projects/679d80d3975f4cfcb02f743c95035e05 => generated 302 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:17.188620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.222205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.261687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355a961d-7370-47ba-9a5c-1c71e860ffe0 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.284457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71d3a3f-ff8b-4cd5-978c-6df54aa01f8b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.295155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.295966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.296252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.296532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.306543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.307232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:17.315281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:17.318398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 228/447] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:17.319219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.319981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.319981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.319981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.319981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.320232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=bdf6277a543a4a4796fbbdb19658a494, scope.project.id=679d80d3975f4cfcb02f743c95035e05) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:17.320232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.321560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.327700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 220/448] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=bdf6277a543a4a4796fbbdb19658a494 => generated 611 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:17.328515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.433589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a739a7-d61a-4a68-9a6b-4eed78f22bed None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.445599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fbdac8-674f-4f3a-8143-35daf0c52b12 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.457067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.473658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.473658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.473658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.474165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] PATH_INFO: `/v3/groups/26ca192e55164b22b93c29a8b04df8be` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.475373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] RBAC: Authorizing `identity:get_group(group_id=26ca192e55164b22b93c29a8b04df8be)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.476836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.478810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 229/449] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/groups/26ca192e55164b22b93c29a8b04df8be => generated 226 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:17.484411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.490649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.493203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.493203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.493203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.493203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:17.493203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.494279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.505702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 221/450] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:17.511211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.569444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.607770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20abf80-38af-4e9e-aa25-4865695582a5 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.628136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b773e29c-e197-41cd-b260-c2f3f0a526d2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.647289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.647289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.647289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.647289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.648102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] RBAC: Adding query filter params (group.id=26ca192e55164b22b93c29a8b04df8be, role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=679d80d3975f4cfcb02f743c95035e05) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:17.648417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.650508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.656835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 230/451] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/role_assignments?group.id=26ca192e55164b22b93c29a8b04df8be&scope.project.id=679d80d3975f4cfcb02f743c95035e05&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 611 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:17.665423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.666117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.666403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.666682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.743781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.745173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.796363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.850066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 222/452] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 338 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:57:17.854426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:17.907978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:17.955031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d57610-bd58-4dc0-b345-608a51cf2c1e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:17.987608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:17.988452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:17.988819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:17.989096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] PATH_INFO: `/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:17.990333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] RBAC: Authorizing `identity:get_project(project_id=e4521befd6aa4cfbb3b9af1101181f7f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:17.991756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:17.993439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 231/453] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/projects/e4521befd6aa4cfbb3b9af1101181f7f => generated 344 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:17.999194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:18.093749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0c52ae-d7b7-42bb-aa03-1dd293fd9f22 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:18.125442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac9222d-c5d8-42cf-8405-0d0d74e511ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:18.126821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9222d-c5d8-42cf-8405-0d0d74e511ed None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:18.127102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9222d-c5d8-42cf-8405-0d0d74e511ed None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:18.127376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac9222d-c5d8-42cf-8405-0d0d74e511ed None admin] PATH_INFO: `/v3/groups/401ac447274c429b86fce15abbb6c449` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:18.128508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9222d-c5d8-42cf-8405-0d0d74e511ed None admin] RBAC: Authorizing `identity:get_group(group_id=401ac447274c429b86fce15abbb6c449)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:18.129949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac9222d-c5d8-42cf-8405-0d0d74e511ed None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:18.131799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 223/454] 10.222.0.20 () {56 vars in 1180 bytes} [Wed Jul 6 16:57:17 2022] GET /identity/v3/groups/401ac447274c429b86fce15abbb6c449 => generated 229 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:18.137474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:18.231890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e2532f-fdaa-4a4e-9aee-6864519a8784 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:18.250636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:18.264297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:18.264838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:18.265116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:18.265388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:18.266230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] RBAC: Adding query filter params (group.id=401ac447274c429b86fce15abbb6c449, role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=e4521befd6aa4cfbb3b9af1101181f7f) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:18.266538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:18.267981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1e8bbea-2d50-41fc-9024-89dd415000c5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:18.273482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 232/455] 10.222.0.20 () {56 vars in 1376 bytes} [Wed Jul 6 16:57:18 2022] GET /identity/v3/role_assignments?group.id=401ac447274c429b86fce15abbb6c449&scope.project.id=e4521befd6aa4cfbb3b9af1101181f7f&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 611 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:20.692825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db528b-2c3a-4752-8b56-3f126cdc6083 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:20.693809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db528b-2c3a-4752-8b56-3f126cdc6083 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:20.694316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39db528b-2c3a-4752-8b56-3f126cdc6083 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:20.696175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 224/456] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:20 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:20.701206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcc0bd-3d95-4fdc-844b-bf2e74e4df25 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:20.701628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcc0bd-3d95-4fdc-844b-bf2e74e4df25 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:20.701756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5fcc0bd-3d95-4fdc-844b-bf2e74e4df25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:20.726100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b5fcc0bd-3d95-4fdc-844b-bf2e74e4df25 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:20.733687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b5fcc0bd-3d95-4fdc-844b-bf2e74e4df25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:20.816439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 233/457] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:20.864743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db528b-2c3a-4752-8b56-3f126cdc6083 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:20.894364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.014721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39db528b-2c3a-4752-8b56-3f126cdc6083 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.031856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cecc7-4f15-4adb-ba8b-6e32d656f81a None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.032527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cecc7-4f15-4adb-ba8b-6e32d656f81a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.032992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-494cecc7-4f15-4adb-ba8b-6e32d656f81a None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.034845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 234/458] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:21.053948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8982fc-2c1d-4c1b-bb4a-15d116656985 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.054596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8982fc-2c1d-4c1b-bb4a-15d116656985 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.055102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8982fc-2c1d-4c1b-bb4a-15d116656985 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.060222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.061024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.061309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.061592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.072804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.074234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.087042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7a8982fc-2c1d-4c1b-bb4a-15d116656985 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:21.088248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7a8982fc-2c1d-4c1b-bb4a-15d116656985 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-f42520f0-3ffc-4cdf-9efc-65f336cc87b9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:21.096587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:21.097461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:21.098351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:21.098351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:21.098351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:21.098351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:21.098351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 225/459] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:21.099380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581bd7-9959-4a42-a41d-1fa960f39bfe None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.099685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581bd7-9959-4a42-a41d-1fa960f39bfe None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.099955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48581bd7-9959-4a42-a41d-1fa960f39bfe None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.101319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 226/460] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:21.105574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581bd7-9959-4a42-a41d-1fa960f39bfe None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.170112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 235/461] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:21.171755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.172272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.172753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.191325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.206718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:21.208986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:21.232679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48581bd7-9959-4a42-a41d-1fa960f39bfe None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.262855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.280663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.282065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.282558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.282981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.284063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:21.284964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.287005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.298480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 236/462] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:21.298480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.326342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 227/463] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:21.327406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.413484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a966bb09-83a4-4623-a726-646b454fc9eb None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.436021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d05f4f9-dbea-4bea-b847-47774a6eaefd None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.448803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.449596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.449879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.450187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.461009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.462505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.464163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.472066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.472801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.477892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.477892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:21.481394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:21.482451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:21.483477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:21.483477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:21.483477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:21.483477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:21.483477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 237/464] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:21.483477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.486658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.488132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-1d6ef55c-8710-423d-b627-c62d97fe86ad None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:21.509560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:21.510501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:21.511334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:21.511334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:21.511334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:21.511334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:21.511334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 228/465] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:21.512000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daff517-7287-4ed4-94e3-23c0f807c0a4 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.512268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daff517-7287-4ed4-94e3-23c0f807c0a4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.512546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daff517-7287-4ed4-94e3-23c0f807c0a4 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.513937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 229/466] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:21.514493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daff517-7287-4ed4-94e3-23c0f807c0a4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.525539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.602297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e0821e-22a4-4e96-a0ce-97f967264bc6 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.632928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daff517-7287-4ed4-94e3-23c0f807c0a4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.639860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-496c3dee-760b-4b6a-8396-a1f7aad3f19c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.640526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3dee-760b-4b6a-8396-a1f7aad3f19c None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.640810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3dee-760b-4b6a-8396-a1f7aad3f19c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.641089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-496c3dee-760b-4b6a-8396-a1f7aad3f19c None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.641825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3dee-760b-4b6a-8396-a1f7aad3f19c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.643327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-496c3dee-760b-4b6a-8396-a1f7aad3f19c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.670584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.671347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.671699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.672044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.672964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:21.673861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.675330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.686665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 230/467] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:21.689435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.728396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.743185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 238/468] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:57:21 2022] POST /identity/v3/users => generated 246 bytes in 260 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:21.744929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.745219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.745497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.772528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:21.774551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:21.811764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e20fce3d-acb1-41a0-823d-1b328131f6b5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:21.861090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:21.862759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:21.863233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:21.863935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:21.864915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:21.865402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:21.867256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:21.867378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 239/469] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:21.870320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:21.887876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:21.900373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 231/470] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:21.906296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.011835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d271c441-1f23-4f18-87d8-6bef4dddbeb8 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.021567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:22.025260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18834a35-3bce-4f0a-af18-380d5fbb47da None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.050218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.051049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.051468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.051817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.052589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:22.054110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:22.067187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3faa06f9-7028-48bb-8179-0abb2b13d53a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.068289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa06f9-7028-48bb-8179-0abb2b13d53a None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.069037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa06f9-7028-48bb-8179-0abb2b13d53a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.069316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3faa06f9-7028-48bb-8179-0abb2b13d53a None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.070133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa06f9-7028-48bb-8179-0abb2b13d53a None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:22.071550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3faa06f9-7028-48bb-8179-0abb2b13d53a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:22.139237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 240/471] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:57:21 2022] POST /identity/v3/users => generated 248 bytes in 271 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:22.142313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.164800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 232/472] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:57:21 2022] POST /identity/v3/users => generated 248 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:22.243055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:22.246193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc559-4f9d-4b5a-a314-7a3751ba23ff None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.246482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc559-4f9d-4b5a-a314-7a3751ba23ff None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.246756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc1fc559-4f9d-4b5a-a314-7a3751ba23ff None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.248501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 233/473] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:57:22.254356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.254645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.254924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.287257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:22.288528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:22.312289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae8c0b08-0a31-4892-aaa5-6c3a31b7910b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.366733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.367573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.367870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.368137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.383439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:22.384912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:22.402901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 234/474] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:22.404795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:22.405597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:22.406468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:22.406468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:22.406468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:22.406468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:22.406468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 241/475] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:22.411920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.428462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.526945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:22.563075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca7b8cd-3e26-4df1-bf80-1a2695c9621b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.567963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8603ec93-b55c-40e3-8027-6dd61e235cd9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.586541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:22.604637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.605309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.605586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.605859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.608263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:22.609667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:22.633014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.633674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.633953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.634277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.635001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:22.635307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:22.636799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:22.643930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.sql.core [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 16:57:22.643930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 16:57:22.643930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [parameters: {'id': 'e7ca004fdd1f467993a6d70a913a938c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 16:57:22.643930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80632) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application conn.query(q) Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application result.read() Jul 06 16:57:22.664736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return ref.to_dict() Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 16:57:22.665623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application next(self.gen) Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application yield resource Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application next(self.gen) Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise self.value Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application session.commit() Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 16:57:22.666586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self.session.flush() Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application compat.raise_( Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 16:57:22.667435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 16:57:22.668364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application conn.query(q) Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application result.read() Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 16:57:22.669181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [parameters: {'id': 'e7ca004fdd1f467993a6d70a913a938c', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:22.669956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Jul 06 16:57:22.673779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:22.676081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 242/476] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 6 16:57:22 2022] POST /identity/v3/roles => generated 144 bytes in 238 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:22.676224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 235/477] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:22.678982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.683064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.803615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d91df-00fa-41ad-ae3a-2a01fee2b75d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.852282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.854497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.854779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.855723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.875567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d9e2dd-9af6-4371-845b-a987a4310f78 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:22.878354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:22.892824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:22.893730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:22.894560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 236/478] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:22 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:22.906379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:22.926434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:22.938523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5f542d7-c889-445d-bb74-8c705c678296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:22.941533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f542d7-c889-445d-bb74-8c705c678296 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:22.941533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f542d7-c889-445d-bb74-8c705c678296 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:22.941533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f542d7-c889-445d-bb74-8c705c678296 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:22.941533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f542d7-c889-445d-bb74-8c705c678296 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:22.942528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5f542d7-c889-445d-bb74-8c705c678296 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:23.034788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 243/479] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:57:22 2022] POST /identity/v3/users => generated 249 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:23.056383 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e204001f-b601-4dd6-ab09-22c1fe76a3b0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:23.101484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:23.102210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:23.102495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:23.102769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:23.103627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:23.103982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:23.105497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337952e-463c-417f-a243-1bd442276b44 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:23.122547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 237/480] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:22 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:24.270049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a8ea4-43dd-4593-9fc6-08ac4704603b None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.270738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a8ea4-43dd-4593-9fc6-08ac4704603b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.270738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727a8ea4-43dd-4593-9fc6-08ac4704603b None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.272217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 244/481] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:24.277243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.277722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.277883 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.299426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:24.300654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:24.380379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:24.386684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 238/482] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:24.413841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a8ea4-43dd-4593-9fc6-08ac4704603b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:24.484257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:24.571731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727a8ea4-43dd-4593-9fc6-08ac4704603b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:24.612470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f7114c-b2b4-4487-89b3-a14a45f1ef5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:24.613265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7114c-b2b4-4487-89b3-a14a45f1ef5e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.613548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7114c-b2b4-4487-89b3-a14a45f1ef5e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.613824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f7114c-b2b4-4487-89b3-a14a45f1ef5e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.624357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f7114c-b2b4-4487-89b3-a14a45f1ef5e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-43f7114c-b2b4-4487-89b3-a14a45f1ef5e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:24.632409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:24.633255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:24.634067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 245/483] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:24.639644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:24.776535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b47722f-44f3-4a25-aecb-9d510ad80853 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:24.791974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbeede-7cdc-446a-8ea0-2c81202b6e43 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.792281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbeede-7cdc-446a-8ea0-2c81202b6e43 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.792542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7fbeede-7cdc-446a-8ea0-2c81202b6e43 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.797538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 246/484] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:24.803313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb925-28f6-44e6-82d7-e6407e9a5157 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.803543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb925-28f6-44e6-82d7-e6407e9a5157 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.803825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7eb925-28f6-44e6-82d7-e6407e9a5157 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.825598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:24.826317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.826604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.826881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.827642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:24.827950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:24.829631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:24.839568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ad7eb925-28f6-44e6-82d7-e6407e9a5157 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:24.840758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ad7eb925-28f6-44e6-82d7-e6407e9a5157 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:24.847180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 239/485] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:24 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:24.853386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:24.929529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:24.939217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 247/486] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:24.940715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645ec4c-8960-470b-b451-510b7919e05f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.941836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645ec4c-8960-470b-b451-510b7919e05f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.941836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a645ec4c-8960-470b-b451-510b7919e05f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.942964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 248/487] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:24.959783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:24.960074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:24.960352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:24.979682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:24.981367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:24.989509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f74a0a-c7c6-4584-965d-7940a7df3126 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.011405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.031013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.032272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.033172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.033387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.047541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.049314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.066647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 249/488] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:25.067682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:25.069474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:25.070511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:25.074590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:25.074590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:25.074590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:25.074590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:25.074590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 240/489] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:25.076222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.191675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c7e973-be59-4f45-b1b5-9bd488e15375 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.209076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-608dcff7-c62f-405a-bc87-fa1ed570c4d6 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.224353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.238199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.239321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.239612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.239894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.251461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.251461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.251461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.251461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.251768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:25.251768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.252196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:25.252297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:25.261356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:25.262270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:25.263046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:25.266106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 250/490] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:25.267832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.271671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 241/491] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:25.273043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.295666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.386789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85e5d1bf-acc6-4331-9334-627b85785ab9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.398097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b34d4d-4b7a-4a09-b8b1-9dcb99427b0a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.426060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.427304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.427888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.428365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.429382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:25.429921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.431723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.441090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 242/492] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:25.441375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.441985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.442681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.446433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.446936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.459923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:25.468003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:25.468887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:25.469683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:25.476972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 251/493] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/roles/service => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:25.478003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.484914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.566581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e1d407-62db-4e3e-a377-94f287fb3e67 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.573207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.592846 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d9ae6e-73f2-4b67-80fc-42dacaabe0c9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.603449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.604241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.604526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.604809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.612050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.613486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.628949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:25.629548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:25.630478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:25.631639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:25.632154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.632154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.632154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.632409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 243/494] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:25.632409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.646887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.648382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-1288cfba-d84c-419b-a3b9-dec15050a3f4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:25.666683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:25.667542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:25.668427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:25.668427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:25.668427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:25.668427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:25.669086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 252/495] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:25.670489 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576e86-fa3f-4696-ba77-2bf5081c1463 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.670783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576e86-fa3f-4696-ba77-2bf5081c1463 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.671057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10576e86-fa3f-4696-ba77-2bf5081c1463 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.672457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 253/496] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:25.673725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576e86-fa3f-4696-ba77-2bf5081c1463 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.726946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.733771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e0940a8-0915-42de-8e83-205104a8928e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.769076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.769836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.770235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.770584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.771410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:25.771874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.773262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02946471-1f03-49dc-a31c-8005b28f008d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.773358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10576e86-fa3f-4696-ba77-2bf5081c1463 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.781404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 244/497] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:25.782966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527f269-32b2-49d2-8326-f13221eace3a None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.783264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527f269-32b2-49d2-8326-f13221eace3a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.783540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4527f269-32b2-49d2-8326-f13221eace3a None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.784789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 245/498] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:25.785472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527f269-32b2-49d2-8326-f13221eace3a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.806272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:25.810877 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.811542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.811817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.812102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.812919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:25.813224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.815344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a61a6b2-ee87-4d98-afe8-ee6eaf6d43db None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.850676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 254/499] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:25.851892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.852181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.852450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.868531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:25.869710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:25.887085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4527f269-32b2-49d2-8326-f13221eace3a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:25.919612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:25.920314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.920665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.921010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.921802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:25.922215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:25.924108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4813288-fe36-41d2-9409-b8afe95ae046 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:25.934840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 255/500] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:25.940692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 246/501] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:25.940822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:25.940911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:25.940911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:25.940911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:25.956116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:25.957499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:25.968331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.024030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 247/502] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:26.024855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.046615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c08722c-d54a-4d26-a039-8d027727b30a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.067399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.080667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.081454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.081738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.082013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.093056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.094560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:26.113080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:26.114141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:26.115061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:26.115061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:26.115061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:26.115061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:26.115061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 256/503] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:26.116579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.125847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56f4e53c-0efc-47e7-b933-22c46c5444bf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.159689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.160332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.160611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.160889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.176165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.215770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7d0b83-0c70-4e58-a099-a6fac2f9f348 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.227113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.228557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.249913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.250839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.251153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.251434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.258716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.260135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:26.275773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:26.276844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 16:57:26.277799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:26.281538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 257/504] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:26.282776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.314569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.326286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 248/505] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:26.328646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.372499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.386969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae4a7bfa-3287-4dff-a459-0cb55585c962 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.419499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.420284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.420572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.420854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.425046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d38384ab-78a1-4522-9bd2-4aeeb5c157c8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.431365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.432801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:26.449779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:26.450814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:26.451655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:26.451655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:26.451655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:26.451655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:26.451655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 258/506] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:26.452141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.461651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.462478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.462758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.463029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.473468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:26.480988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:26.482065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 249/507] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:26.483036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.538040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.557040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-355b993f-4d7d-493b-8aa7-567b93d5ffda None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.585933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1dff37-706e-436d-a4c9-f596c8c04cb9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.590970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.591620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.591900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.592174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.592724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.592891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:26.593196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.594615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.606162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 259/508] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:26.606939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.620224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.620902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.621191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.621472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.622445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:26.623018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.624728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.662083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 250/509] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:26.662904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.705234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0ee0e8-9431-4cc8-a009-d3d5023c3ad1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.737883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.738684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.738967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.739234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.749516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.751000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.753389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.761648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240cef78-70ca-4d96-a813-0b54ed98a2b0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:26.768680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:26.769520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:26.770784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:26.770784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:26.770784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:26.770784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:26.770784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 260/510] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:26.770784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.799052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.799745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.800032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.800313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.801041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:26.801351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.802774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.814324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 251/511] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:26.815100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.839553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:26.875252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f8a9c6-6940-4e99-8fca-a91f89d80da7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.908507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.909164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.909448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.909724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.910509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:26.910821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.912200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.912817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6353c9-1124-4fe7-8515-a04e1df0790e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:26.919981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 261/512] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:26.924666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.946710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:26.947502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:26.947790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:26.948069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:26.956356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:26.957777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:26.972019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:26.972947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:26.973839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 252/513] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:26.974468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:26.981144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.023295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071f3aa4-7cb5-41d0-906f-342df4fe74ec None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.054411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.056988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.057633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.057914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.058229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.070047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04bc8152-63df-4002-8248-d62176d4befe None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.103468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.104120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.104395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.104671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.105380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:27.105686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.107113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.118057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 253/514] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:27.118825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.128770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.130288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.185442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.217771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ff6c219-d8b5-463a-b985-21326484e25e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.226176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 262/515] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:27.226991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.255009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.255669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.256193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.256474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.257166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.258624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.324036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22ad296-4d3a-41b4-8ee8-97608f1f4908 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.326924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.331411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 254/516] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:57:27 2022] POST /identity/v3/users => generated 247 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:27.332198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.361575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.362427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.362703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.362987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.375087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.377263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:27.397160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:27.398166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:27.399160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:27.399160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:27.399160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:27.399160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:27.399160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 263/517] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:27.399432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.414519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.455920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1559e070-bb3c-44e5-9a24-b7cd4ad544f9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.496603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.497207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.497493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.497774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.498665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:27.498986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.500410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.519207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5658748-8d6e-40c6-81f5-16663023627a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.521690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 255/518] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:27.521690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.559318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.560187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.560541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.560897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.568932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.570435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:27.586463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:27.587348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:27.588195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 264/519] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:27.588669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.594617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.639739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4941514c-06ef-4646-9aef-4c35cc74f7e7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.661672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.678754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.679774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.680352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.680638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.693076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.694576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.694677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf5649b-efa9-4d03-b6f3-c4b8518559c0 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:27.713581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:27.714505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:27.715349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:27.715349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:27.715349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:27.715349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:27.715349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 256/520] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:27.716201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.733233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.733943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.734263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.734537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.735265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:27.736131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.737510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.765145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 265/521] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:27.765145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.828472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adf6517-f691-4c5e-bc49-bf1abb98d471 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.842512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.863708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.864369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.864640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.864916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.866219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f41b85-5e61-46d4-8ac0-2cb1741bfc45 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:27.896761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:27.903566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:27.903845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:27.904126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:27.904427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:27.905217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:27.910217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.910217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:27.930620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 266/522] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:27.930620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:27.946653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:27.948126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.030694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31163a31-c5ff-4859-b9b1-97f92c1e83b6 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.064868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.065537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.065702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 257/523] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:28.065822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.066130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.066860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:28.067170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.068573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.071592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.081051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 267/524] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:28.081874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.084596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.133546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.179562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5259d93-6cc1-4833-a82e-243f1af5f81d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.185118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5922f1e8-9271-448c-b734-a07a3079b3cd None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.216849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.217644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.217997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.218250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.219580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.220784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.221062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.221328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.222181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=45e533c543494ad2a9a294458fa79d14) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:28.222485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.223903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.226233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.228098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.237517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 268/525] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/role_assignments?user.id=45e533c543494ad2a9a294458fa79d14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:28.246154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:28.246343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:28.247181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 258/526] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/users/neutron => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:28.248052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.351311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.372985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f37ea4-cd01-41e3-9715-22b640a7060a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.390010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.391106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae6ef274-527f-45e0-bb26-e03c07392936 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.420949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.421861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.422366 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.422723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.428267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.429267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.429741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.430216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.435763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.437562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.437687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.440232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:28.456172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:28.457427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:28.458293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:28.458722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:28.459471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:28.460306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:28.460306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:28.460306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:28.460306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:28.460306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 269/527] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:28.461770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.462473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 259/528] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:28.464939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.574726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ba3ef3-15f7-4cbd-863c-641b798c1502 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.606814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.610322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06f203f-ec47-4e5c-a5ff-488d13c5fa1e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.612523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.613180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.613462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.613739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.614491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:28.614796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.619059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.628460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 260/529] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:28.629297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.652345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.653167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.653455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.653728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.654641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:28.654952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.656656 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.676036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 270/530] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:28.676948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.706446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.737225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06d73b0-c9a1-40c6-92e7-68aabf2e06d0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.783626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.785188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.785467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.785740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.786568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:28.786880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.788335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.795287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8a5912-ff4a-462a-b965-c9144e7a10e6 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.810177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 261/531] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:28.810177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.846243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.847189 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.847574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.847971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.856889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:28.858856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:28.868170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:28.879004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:28.879879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:28.880714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:28.885520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 271/532] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:28.886451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:28.941538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1842ba2c-f288-4489-8bf9-e849ffc062cf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:28.978004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:28.979075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:28.979562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:28.980013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:28.992777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:29.011143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-604594b2-8925-4920-bf7f-96cead1e6553 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.049279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.050039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.050404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.050754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.051750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=62d81f5f899b4113a6a54f0712725656) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:29.052129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.053648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.054313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.055949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.065376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 272/533] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/role_assignments?user.id=62d81f5f899b4113a6a54f0712725656&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:29.066198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.123838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:29.167859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 262/534] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:28 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 359 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:29.174424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.294135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6bd5b4-5229-45ec-8cef-2b393809bcef None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.317929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1aabbb-5902-4f81-a2fb-17daa6d3337c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.347339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.348424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.349062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.349517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.368270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.370705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.390822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.391457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.391729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.392009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.392814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:29.393121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:29.394162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:29.395067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:29.395895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:29.395895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:29.395895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:29.395895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:29.396125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.398261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 263/535] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:29.403997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.409891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:29.418460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 273/536] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:29.424573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.447083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:29.544824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c3da0a-d7b0-4c7d-b1db-88eebbcd13f5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.557146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ccb9ef8-0cb4-43ec-a164-6c89309868f9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.580075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.580741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.581030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.581378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.582141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:29.582452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.583848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a9bae6a-df6c-43dc-b0d6-6852045b5f01 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.595598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.596252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.596534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.596768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 264/537] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:29.596943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.597768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=ba635abc81fd47c6b680836c67eeeeea) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:29.598116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23d7c-070b-4cc2-a02f-ee1514a57f1c None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.598216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.598409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23d7c-070b-4cc2-a02f-ee1514a57f1c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.598694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdf23d7c-070b-4cc2-a02f-ee1514a57f1c None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.599642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed225c3e-8818-4778-846d-9d56a91ce968 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.599920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 265/538] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:29.604790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf23d7c-070b-4cc2-a02f-ee1514a57f1c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.606393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 274/539] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/role_assignments?user.id=ba635abc81fd47c6b680836c67eeeeea&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:29.607862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.608202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.608506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.627661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:29.628966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:29.678309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:29.705544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 275/540] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:29.742646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.742960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdf23d7c-070b-4cc2-a02f-ee1514a57f1c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.744807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:29.809144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.809956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.810306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.810588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.822375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:29.823866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:29.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:29.845217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:29.846086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 266/541] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 241 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:29.852482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:29.883434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-116e52d7-6d01-4e67-9ac3-25d5b97a53be None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:29.925083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:29.925891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:29.926206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:29.926483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:29.951235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:29.959549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:29.960436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:29.961219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 276/542] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:29.974369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.060921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0708134-5273-48c3-b345-56cc24d54e21 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.094414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:30.114361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:30.136011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.136695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.136982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.137260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.138074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:30.138390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:30.139831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:30.154402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 267/543] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:30.163402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.173612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d96b62d-2360-44f6-91b3-51fbaa28ebeb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.209208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.209861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.210184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.210466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.211285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:30.211600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:30.213319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:30.222935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 277/544] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:29 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:30.228376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.337638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab222837-c2e5-4776-88f8-29b74dd49fb9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.363120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:30.375419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.376875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.377165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.377561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.390309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:30.391959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:30.412353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:30.413259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:30.414136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:30.414136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:30.414136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:30.414136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:30.418331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 278/545] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:30.419566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.420369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b8a9073-8b23-4bbf-9b44-deac53abfe94 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.515338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.515930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.516214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.516491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.517363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=6f78d8aba8a94343b33000d45c22fae8) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:30.517674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:30.519211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecf30c79-66b3-4538-8300-7bdc5ddf9dcf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:30.528797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac5af44-8d3b-488d-8d7f-0feb17c7ff1b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.538061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 268/546] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:30 2022] GET /identity/v3/role_assignments?user.id=6f78d8aba8a94343b33000d45c22fae8&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:30.567581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.568257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.568545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.568825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.569023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a107c5a-b4d6-40bd-bf1a-756bf6349d89 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.569434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a107c5a-b4d6-40bd-bf1a-756bf6349d89 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.569562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:30.569646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a107c5a-b4d6-40bd-bf1a-756bf6349d89 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.569865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:30.571316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:30.571865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 269/547] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:57:30.579584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f73af-f141-4857-8716-0843d6316340 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.579874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f73af-f141-4857-8716-0843d6316340 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.580155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952f73af-f141-4857-8716-0843d6316340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.586977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 279/548] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:30.592607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.612309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-952f73af-f141-4857-8716-0843d6316340 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:30.613565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-952f73af-f141-4857-8716-0843d6316340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:30.636673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:30.704478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:30.725994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ca5bfab-13df-4e4d-bbd0-f087d407f69a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.746977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 270/549] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:30.769504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f73af-f141-4857-8716-0843d6316340 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.803212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.804015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.804298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.804571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] PATH_INFO: `/v3/users/swift` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.816001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:30.817465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:30.846140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:30.847086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:30.847996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 280/550] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:30 2022] GET /identity/v3/users/swift => generated 83 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:30.858986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:30.929077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952f73af-f141-4857-8716-0843d6316340 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:30.966764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:30.967570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:30.967850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:30.968125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:30.989195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:30.996932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:30.997991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:30.998819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:30.999437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 271/551] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:31.006968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.010282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.017563 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c5c880-be2b-41e1-b8d4-002ca1a610db None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.059383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.060391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.060866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.061350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.063156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:31.063731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.065344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.076151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.108263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 281/552] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 6 16:57:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:31.114478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.198841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9128e3ab-0613-4ce0-9b30-3c1533b73701 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.235309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.235986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.236265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.236546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.237303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:31.237611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.239042 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.247847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 272/553] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:31.255684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16e14e1-534b-44a4-b30f-1c4e375bda3e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.259657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.293950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.294971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.295475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.295943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.322134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.367887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.369696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.466703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.473464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b359891-6245-49da-bc9c-294d0bbfbce0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.507972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 282/554] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:31.513621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.529803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.533386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.533386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.533386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.543958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.545512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:31.577108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:31.578643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:31.580341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:31.580341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:31.580341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:31.580341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:31.584028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 273/555] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:31.588648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.638007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.687198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469bda91-405d-4362-9f05-2e7ecb9196f9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.724786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4248b652-113f-4dff-8cb1-f5c1ea6aac21 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.724990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.725825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.726142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.726466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.741770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.744101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.766634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3d108471-3140-4092-9413-e63e6e342b96 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:31.767476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:31.769128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:31.770703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:31.770703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:31.770703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:31.770703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:31.770985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.770985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.771144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 283/556] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:31.771144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81676bec-0a59-4ac0-b7aa-a7d7f32f022e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.771144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81676bec-0a59-4ac0-b7aa-a7d7f32f022e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.771144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81676bec-0a59-4ac0-b7aa-a7d7f32f022e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.776300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 284/557] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:31.776537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.777061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81676bec-0a59-4ac0-b7aa-a7d7f32f022e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.777707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:31.778196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.779755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14fc66ba-0c55-4dcb-b26c-a5ca9afae941 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.796888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 274/558] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:31.799123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.799626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.800103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.817518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:31.819074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:31.823627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.898732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 275/559] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:31.899499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:31.918260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81676bec-0a59-4ac0-b7aa-a7d7f32f022e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:31.926797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:31.953499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:31.955242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.955804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.956295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.957016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:31.957322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:31.958719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6a23ce-d4f3-4c8a-90b6-de15f9458bf2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:31.970519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 285/560] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:31.975457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4582-a9f8-4747-901a-8044f63eb61a None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:31.975760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4582-a9f8-4747-901a-8044f63eb61a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:31.976039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ab4582-a9f8-4747-901a-8044f63eb61a None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:31.981346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 286/561] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:31.981346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4582-a9f8-4747-901a-8044f63eb61a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.018495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cad6527-25fb-4a5f-958e-ebf028d57755 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.062951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.064792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.065079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.065559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.073202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.074717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.078374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.083427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4ab4582-a9f8-4747-901a-8044f63eb61a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:32.091993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:32.092961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:32.093881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 276/562] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/users/nova => generated 82 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:32.094515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.123539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6d018e7-e53a-416d-bc76-603e7e9d4931 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.124322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d018e7-e53a-416d-bc76-603e7e9d4931 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.124605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d018e7-e53a-416d-bc76-603e7e9d4931 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.124879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6d018e7-e53a-416d-bc76-603e7e9d4931 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.136122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6d018e7-e53a-416d-bc76-603e7e9d4931 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f6d018e7-e53a-416d-bc76-603e7e9d4931 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:32.144492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:32.145399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:32.146738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 287/563] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:32.147431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.147431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.147790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.163879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:32.164983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:32.187109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.207173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6eaa796-13c2-4c54-87bb-6eeee3acda31 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.237835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 288/564] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:32.243746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.244572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.244859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.245136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.251553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.254957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.256682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:32.276323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:32.277257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:32.278188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 277/565] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/projects/service => generated 88 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:32.278753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.340731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.363908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38d1ffb2-2fd8-4577-90a7-9924f69a33f1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.384222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21dcf58f-cf8f-4312-ba9f-fef5f404cf6d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.400840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.401511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.401853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.402162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.403047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:32.403358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.404785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.421188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.421773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.422085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.422365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.423652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:32.423966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.425327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.427235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 289/566] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:32.428699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.433901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 278/567] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:32.434692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.451401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.540805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27f9443-a76f-4b96-a424-39c3c24b536c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.542017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64d685d4-5a36-47ca-bc08-0d96c1d50bed None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.567938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.580144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.580689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.580878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.581097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.584075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.584173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.584173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.584173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.584354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:32.584354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.584354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.592748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:32.600544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:32.601478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 290/568] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:32.607618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.608369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 279/569] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:32.608369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.684060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.709765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6798e05-2b00-4203-8acd-88e3b6d8f5e4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.709981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dffacd2e-9e53-43dd-801e-23a1b22b13f0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.746170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.746766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.746955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.747239 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.747517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.747613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.747821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.748094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.759180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.759696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.760621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.761137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:32.778083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:32.778946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:32.785100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:32.785100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:32.785100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:32.785100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:32.785344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:32.786380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:32.787453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:32.787453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:32.787453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:32.787453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:32.787707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 291/570] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:32.787793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 280/571] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:32.787869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.787938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.831031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.895502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19580a1c-86fa-4a6b-86c1-ff1681ec625e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.895671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62faf761-c3fe-4385-b6de-0da4ec0c6ac4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:32.920319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:32.928735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.929160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:32.929390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.931668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.931769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.931855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.931955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.931955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.932124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:32.932124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.932296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=0d90c264ccd44a6e88ac202f4e6a4fde) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:32.932296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:32.932480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.932884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913e7c57-1ee1-4957-9225-c13a218d2ebe None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:32.938165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 292/572] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/role_assignments?user.id=0d90c264ccd44a6e88ac202f4e6a4fde&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:32.945176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 281/573] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:32.945176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:32.946719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035262-7db4-4392-b9d1-45348fdcfaae None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:32.947081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035262-7db4-4392-b9d1-45348fdcfaae None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:32.947429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04035262-7db4-4392-b9d1-45348fdcfaae None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:32.948947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 293/574] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:32.949798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035262-7db4-4392-b9d1-45348fdcfaae None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.061778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.067955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb2184f-44d9-46a2-bb36-f4dafbae461c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.069255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04035262-7db4-4392-b9d1-45348fdcfaae None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.107602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.108270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.108555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.108835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.109570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:33.109730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.109907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.110955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.111234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.111505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.111867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.112227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:33.112529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.113894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19818dc-1c52-44e4-b8fe-feea1698fd0f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.128141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 282/575] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:33.128141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.130833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 294/576] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:33.134582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.134582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.134582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.150300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:33.151485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:33.201295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.230054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 295/577] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:33.230054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.242980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e00321-d08f-4d2a-9f91-3f6312fc60c3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.280098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.281052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.281460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.281741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.293298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.294770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:33.312633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:33.313800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:33.314774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:33.314774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:33.314774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:33.314774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:33.314774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 283/578] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:33.315326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.326533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.327181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9306d5d8-adb9-42af-9160-c94951e948e2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.364220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.365103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.365450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.365720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.372824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.374307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:33.388770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:33.389852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:33.390815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 296/579] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:33.391304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.428026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72d85fcd-6c24-45cd-9c6e-bfe18fac506e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.435630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.464846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.465570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.465859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.466175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.475329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.476792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:33.494959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:33.495868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 284/580] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/users/glance => generated 84 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:33.501868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.502619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9c69f7-f81c-4926-9817-95d32cc2ab5d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.539658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.540529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.540876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.541214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.555414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:33.563221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:33.564696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:33.565509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 297/581] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:33.566214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.580817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.615518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceadf552-fe29-4864-b40f-6796dd5ee066 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.652107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.652773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.653061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.653354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.654113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:33.654427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.655814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.668891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 285/582] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:33.673336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.674181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.677103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c101ac12-7749-4e35-856b-b6b86eaa19e1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.713634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.714320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.714606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.714936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.715684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:33.715995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.717421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.730605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 298/583] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:33.731391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.787177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c5707e-b581-4072-a44d-61eea25762c9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.816330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.824836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.825570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.825851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.826163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.827123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:33.827547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.829569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.833395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-302937bc-b202-4e24-9c65-31fba82e2726 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.855558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 286/584] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:33.855558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.867940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:33.869231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:33.869824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:33.870141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:33.871044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:33.871350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:33.872706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:33.881654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 299/585] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:33.882430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:33.909064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:33.966615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-769486ab-aee1-49b3-a372-8fc955204fa0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:33.994415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-700b327f-8a62-42d5-854f-4ba3fb367862 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.002676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.003475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.003758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.004035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.011627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.013071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:34.028991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:34.029995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:34.030970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 287/586] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:34.031551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.038180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.039083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.039363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.039634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/45e533c543494ad2a9a294458fa79d14/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.055733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=45e533c543494ad2a9a294458fa79d14, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.057174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.078727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.134057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 300/587] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:33 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/45e533c543494ad2a9a294458fa79d14/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:34.134057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.139994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfecce7b-2d31-4a54-a989-6adc350fcb03 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.180052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.180856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.181139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.181416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.196331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.198002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.215283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:34.219394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:34.220490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:34.221452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:34.221452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:34.221452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:34.221452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:34.222190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 288/588] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:34.224871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.268648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7deb43da-de8f-4492-ba2b-a8a051d7366d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.326005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.326953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.327321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.328132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.341934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.344069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.345284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.348801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b877dc41-c0a1-4645-8588-a6ba39e4daf5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:34.378114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:34.379205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:34.380153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:34.380153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:34.380153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:34.380153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:34.380153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 301/589] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:34.380153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.385911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522111db-70de-4592-bb52-40a694828139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.386374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522111db-70de-4592-bb52-40a694828139 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.386914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522111db-70de-4592-bb52-40a694828139 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.387192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-522111db-70de-4592-bb52-40a694828139 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.388032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522111db-70de-4592-bb52-40a694828139 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:34.388340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522111db-70de-4592-bb52-40a694828139 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.389760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-522111db-70de-4592-bb52-40a694828139 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.417845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 289/590] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:34.419168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522111db-70de-4592-bb52-40a694828139 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.492091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581ede6b-9c40-4534-bbce-f5222e64f5b7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.516164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.527072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.532701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.532701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.532701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.532701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:34.532701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.533113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-522111db-70de-4592-bb52-40a694828139 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.533200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.548454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 302/591] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:34.549327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.569860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.570740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.571125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.571504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.572441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:34.572847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.574347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.587563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 290/592] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:34.588559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.609019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.656249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16477bd9-02aa-40c6-9328-0c3eef232665 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.693614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.694683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.694962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.695236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.707158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.708595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.716190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12933795-02cd-4e53-a73b-98cf602d66d4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:34.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:34.733308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:34.735526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:34.735526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:34.735526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:34.735526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:34.735526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 303/593] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:34.735526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.767937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.768649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.768931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.769207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.778002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.778146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.778247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:34.793276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:34.794500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:34.795389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:34.799326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 291/594] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 207 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:34.800162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.859705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d5c78d-bf69-4d23-b93b-325581c7443c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.886601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:34.904834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.906099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.906392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.906934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.912117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd1770db-a297-4c46-89d5-e4c9ea28eef6 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:34.917025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.918588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:34.937502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:34.938679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 304/595] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/users/neutron => generated 85 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:34.940228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:34.955718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:34.956438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:34.956931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:34.957107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:34.957855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:34.958240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:34.959748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:34.975486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 292/596] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:34.976301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.052867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.059274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50177136-3c6e-4135-bc1f-228a33e94a61 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.080168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ac1a9b-25c7-4c7b-84bc-909f09430952 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.096750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.097400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.097681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.097951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.098754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:35.099053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.100758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.114001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 305/597] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:35.114802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.120627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.121380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.121665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.121943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.122829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:35.123123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.124554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800696d3-c82e-4f3a-8a7d-1999894af4cb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.127481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.148683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 293/598] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 6 16:57:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:35.148683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccafa4b-a6bf-4ea1-87f0-4875a5e00a40 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.148683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccafa4b-a6bf-4ea1-87f0-4875a5e00a40 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.148683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ccafa4b-a6bf-4ea1-87f0-4875a5e00a40 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.148683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 294/599] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:35.148683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccafa4b-a6bf-4ea1-87f0-4875a5e00a40 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.222892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73da9cb3-8c57-4700-9898-e456580bc8f4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.255590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ccafa4b-a6bf-4ea1-87f0-4875a5e00a40 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.256813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.257602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.257889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.258205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.265029 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.266546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:35.280267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:35.281152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:35.282018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 306/600] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:35.284306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.297475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963e81ba-53db-40fb-9600-98a14fcd53ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.298957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e81ba-53db-40fb-9600-98a14fcd53ea None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.299236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e81ba-53db-40fb-9600-98a14fcd53ea None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.299503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963e81ba-53db-40fb-9600-98a14fcd53ea None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/62d81f5f899b4113a6a54f0712725656/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.305197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.315737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e81ba-53db-40fb-9600-98a14fcd53ea None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=62d81f5f899b4113a6a54f0712725656, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.325204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963e81ba-53db-40fb-9600-98a14fcd53ea None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.389793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e836fdc8-1137-4a95-b6a4-ce1c2aac0a59 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.415363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 295/601] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:35 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/62d81f5f899b4113a6a54f0712725656/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:35.415363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.415363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.415363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.432295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:35.434487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:35.439395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.440203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.440484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.440757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.455035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.456548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:35.475792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:35.476732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:35.477610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:35.477610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:35.477610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:35.477610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:35.477610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 307/602] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:35.482700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.490650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.537816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 296/603] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:35.539461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.583379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.632480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53eaa1e1-e54e-44fc-9fa5-3183f5a031fb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.675705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.677597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.678049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.678471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.679850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:35.680425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.682168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.682642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695184e0-f22b-4d34-bf85-eef1c927a6e9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.698878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 308/604] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:35.700071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.718948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.720439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.720818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.721195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.722131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:35.722537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.728282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:35.737084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 297/605] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:35.742300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.788931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.822568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9be700d-116b-4212-9225-bc67c308d305 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.852544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:35.861104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.862052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.862479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.862818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.871034 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091efc7f-a8ce-4abc-abf5-317b255aed79 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:35.878237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:35.888860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:35.889802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:35.890977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:35.894127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 309/606] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:35.894763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:35.914291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:35.915187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:35.915772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:35.916049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/ba635abc81fd47c6b680836c67eeeeea/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:35.936237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=ba635abc81fd47c6b680836c67eeeeea, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:35.938204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.012612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a1eccb7-f3c5-46b6-b16a-d9e22c6e644c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.024906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 298/607] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:35 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/ba635abc81fd47c6b680836c67eeeeea/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:36.026044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.088815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.089633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.089914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.092256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.109795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.111301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:36.146230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:36.147177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:36.148141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 310/608] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:36.156862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.199620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:36.223562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579656e4-045c-46d0-9ac9-a32b93d0d235 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.239259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:36.273600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.274699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.274991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.275272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.276198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:36.276512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.278572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcb15fa9-bcf7-45c6-8b72-ccbd5055bbd1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.290048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 299/609] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:36.291417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0dce-f53b-4ef8-8adc-bb3700378ce0 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.291709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0dce-f53b-4ef8-8adc-bb3700378ce0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.291990 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1e0dce-f53b-4ef8-8adc-bb3700378ce0 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.297398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 300/610] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:36 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:36.298739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0dce-f53b-4ef8-8adc-bb3700378ce0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.303364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafca77-291f-4a42-b74e-3261e3d73d8c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.338381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.339038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.339315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.339700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.340488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:36.340803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.342485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a935c5-c280-4d20-95a6-94725292a452 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.355195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 311/611] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:36.356597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.356888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.357480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.374939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:36.376849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:36.423571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1e0dce-f53b-4ef8-8adc-bb3700378ce0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.458060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 312/612] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:36.458060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.482179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.483516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.483945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.484397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.499040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.502197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.510942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:36.515523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:36.525138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:36.529566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:36.530487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:36.530487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:36.530487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:36.530487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:36.530487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 301/613] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:36.530487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.592570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824f79ec-fb49-48f1-8ae4-2cbb48471b14 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.633099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.634369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.634888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.635367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/6f78d8aba8a94343b33000d45c22fae8/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.651597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=6f78d8aba8a94343b33000d45c22fae8, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.653373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.663437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-825c43f3-1d85-4724-86d1-5f46046b9510 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.698481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.699283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.699631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.699903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.710783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:36.719340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:36.720860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:36.721675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:36.724769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 313/615] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:36 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/6f78d8aba8a94343b33000d45c22fae8/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:36.725221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 302/615] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:36.728313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.729485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.812442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:36.838930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:36.853664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0279154-c450-46ea-8219-b101d12d38ec None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.872439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbbacc10-516c-4d7a-9ea6-74ec8a4aaa0b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:36.893955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.894694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.895122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.895516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.896581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:36.897000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.898692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.914005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 314/616] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:36.915542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:36.918419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:36.919643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:36.920098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:36.921488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:36.922413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:36.923498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:36.925144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:36.941129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 303/617] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:36.946805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.035661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79bba30-1b1f-41f5-9442-5bd1acd6d144 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.053831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ac23d45-cf20-4014-a98d-e27e6203f8b9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.071868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:37.073458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.074401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.074687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.074962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.089171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.091456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.096517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.097823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.098141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.098422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.108463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.109989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:37.115375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:37.116442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:37.117669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:37.117669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:37.117669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:37.117669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:37.119510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 315/618] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:37.131182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:37.132291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:37.133435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:37.134625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:37.135808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 304/619] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:37.137552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:37.148559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.309336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b7a0c2-28f9-4ad7-a6c5-18520d152932 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.340024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61cbf8f8-a7fb-4567-91b5-d7ab0b1c13ec None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.347125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.348200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.348719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.349196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.350149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:37.350708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.352269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.365635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 316/620] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:37.371408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.413424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.415487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.416282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.417600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.418699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:37.419216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.420863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.453701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 305/621] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 306 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:37.460535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.489088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:37.519384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:37.569711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02baa619-4e9a-4166-a3af-21f41619a272 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.603012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e921ef72-56db-47a8-922a-4f023f0f087d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.640662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.642114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.642525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.642769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.659797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.661213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.662942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.664015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.664513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.665428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.678927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.680629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:37.695003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:37.695990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:37.697671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 317/622] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/users/nova => generated 82 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:37.701140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:37.706249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:37.707663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:37.708539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:37.708539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:37.708539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:37.708539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:37.715063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 306/623] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:37.720288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.842412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:37.853158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51f50315-f5c0-4aa8-b781-c77d7fe589c3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.854372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6cf7464-40e7-4842-8fb7-96fc4cd34775 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:37.882792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:37.893173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.894345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.895787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.895787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.895959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:37.896117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.896512 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.896699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:37.896993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.897362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.897943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:37.898338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:37.899314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aec1b57-2cdd-4789-817a-e94fb88edf3a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.899860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dea1a385-05a9-40b9-9a87-33e3067b3038 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:37.911706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 307/624] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:37.914196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6297-6243-4d67-9301-551c1b953fb7 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.914669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6297-6243-4d67-9301-551c1b953fb7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.915127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef6297-6243-4d67-9301-551c1b953fb7 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.920910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 308/625] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:37.922346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6297-6243-4d67-9301-551c1b953fb7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:37.925733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 318/626] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:37.928254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:37.928613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:37.929004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:37.948231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:37.949723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:38.026127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 319/627] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:38.027291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.046570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef6297-6243-4d67-9301-551c1b953fb7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.092293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.093089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.093371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.093645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.101508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.102904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:38.121916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:38.122856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:38.123801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 309/628] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:38.124285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.136712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.163602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895823e6-4802-4ea3-88be-21ba32e170be None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.177888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.204185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893dddd9-3f90-4a31-97a4-d9af36ff2780 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.205084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dddd9-3f90-4a31-97a4-d9af36ff2780 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.205543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dddd9-3f90-4a31-97a4-d9af36ff2780 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.206126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893dddd9-3f90-4a31-97a4-d9af36ff2780 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.237651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f98072-c9c4-45bf-b872-cd710ca93299 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.273556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.274836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.275129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.275405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.276907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dddd9-3f90-4a31-97a4-d9af36ff2780 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.278516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893dddd9-3f90-4a31-97a4-d9af36ff2780 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.286209 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:38.293833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:38.294950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:38.295803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 310/629] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:38.296513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.367804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.397169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 320/630] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 366 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:38.397169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88165ec-6dd6-4ff9-9426-5b5225a9cd8c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.397169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88165ec-6dd6-4ff9-9426-5b5225a9cd8c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.397169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b88165ec-6dd6-4ff9-9426-5b5225a9cd8c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.397169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 321/631] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:38.397169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88165ec-6dd6-4ff9-9426-5b5225a9cd8c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.408792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-214445b6-c671-4da3-9285-fa5d2f428f93 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.410383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.444510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.445087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.445366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.445642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.446505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:38.446816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.448283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.462176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 311/632] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:38.463144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.511658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b88165ec-6dd6-4ff9-9426-5b5225a9cd8c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.550386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.551913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.552380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.552840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.553766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:38.554313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.555876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a50e9e54-ec49-4d09-8c53-88a41c70a633 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.566902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 322/633] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:38.568323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.568796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.569268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.573305 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1268569a-2fc1-4bb9-9df2-4c6f27d93a46 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.587208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:38.588394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:38.602043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.609697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.610708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.610863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.611115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.621319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.622793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:38.641044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:38.642478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:38.643358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:38.643358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:38.643358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:38.643358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:38.644419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 312/634] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:38.645174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.673579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 323/635] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:38.674619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.676893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.765760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7c10d6-f93c-4af2-bc0e-b04fcf39ceca None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.780625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb034d-a320-43ef-9df6-7ae0b0706fb5 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:38.804046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.805252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.805797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.806155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/0d90c264ccd44a6e88ac202f4e6a4fde/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.816286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:38.816745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:38.817032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:38.817316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:38.823328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=0d90c264ccd44a6e88ac202f4e6a4fde, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.825913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.827459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:38.828909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:38.847056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:38.848157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:38.849072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:38.849072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:38.849072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:38.849072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:38.849072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 324/636] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:38.849519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.890882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 313/637] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:38 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/0d90c264ccd44a6e88ac202f4e6a4fde/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 246 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:38.892621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:38.917410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.931614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:38.977435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac42c191-bc45-4e11-a8f0-4d858cb303cf None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.016297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.017587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.018039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.018409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.019228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:39.019630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.021441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.027652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8aea4074-5edd-4b7a-80aa-0d2ba6a388ad None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.038497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 325/638] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:39.039540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.068352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.069488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.070204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.070681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.085485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:39.094583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:39.095636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:39.096510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:39.097964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 314/639] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:38 2022] GET /identity/v3/roles/service => generated 85 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:39.098848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.172526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78259a4-669f-4a55-a953-0d79d27b805c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.191125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:39.208110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:39.211198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.211866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.212153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.212437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.213169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:39.213479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.214913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.218310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f16f56d4-6607-46f8-82bc-f4d892a7d0d3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.226736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 326/640] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:39.227346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.258922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.259875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.260168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.260748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.268304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.269713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-1d37ade1-67e7-471b-9a29-4268d2557a0a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:39.283974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:39.284959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:39.285876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 315/641] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:39.287099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b22f3-4b3a-484e-b57b-04560b33e631 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.287099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b22f3-4b3a-484e-b57b-04560b33e631 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.287099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b3b22f3-4b3a-484e-b57b-04560b33e631 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.292702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 316/642] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:39.292702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b22f3-4b3a-484e-b57b-04560b33e631 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.337992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204a6ae3-c847-46e8-b012-1d957065fc26 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.373253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.373927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.374239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.374522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.375271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:39.375579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.377573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.385934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 327/643] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:39.386765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.412532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b3b22f3-4b3a-484e-b57b-04560b33e631 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.426229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:39.451442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.452236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.452520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.452796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] PATH_INFO: `/v3/users/glance` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.460080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.461519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-4fc6d999-39e7-483d-9aba-ae8ae03d406f None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:39.476058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:39.477080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:39.478196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 317/644] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/users/glance => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:39.478818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.479398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.479398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.496247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:39.497458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:39.501513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:39.503507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-892a7b12-7456-4db4-96fe-5ec98c14d0c7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.542601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.543147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.543454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.543718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.544513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:39.544823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.546836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.561623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 328/645] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:39.562764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.578513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 318/646] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:39.579436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.668579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:39.675010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4199595e-4d53-4bf3-85a1-8d996043ade5 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.690743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49294a08-502e-420e-b374-a15bd62680e0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.708614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.709408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.709687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.709956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.720661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.722080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.728916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.728916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.728916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.728916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.729282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:39.729282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.730296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.740802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:39.742836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:39.743714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:39.755274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:39.755274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:39.755274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:39.755274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:39.755274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 329/647] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:39.755274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.755710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 319/648] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:39.755710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.855966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3cc5e9a-f2e7-4678-921b-b8a06814c7b1 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.858860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eedcbd77-1141-4446-9f46-3d869389c0e1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:39.889057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5b93-c035-4419-afec-f865a54848af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.889841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5b93-c035-4419-afec-f865a54848af None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.890148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5b93-c035-4419-afec-f865a54848af None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.890442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-199b5b93-c035-4419-afec-f865a54848af None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.895561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:39.896508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:39.897059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:39.897628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:39.898675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=45e533c543494ad2a9a294458fa79d14) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:39.899145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:39.900360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-199b5b93-c035-4419-afec-f865a54848af None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:39.900893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:39.906840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 330/649] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/role_assignments?user.id=45e533c543494ad2a9a294458fa79d14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:39.908269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-199b5b93-c035-4419-afec-f865a54848af None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:39.908476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:39.909412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:39.910265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:39.914690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 320/650] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:39.915677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5b93-c035-4419-afec-f865a54848af None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:39.935250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.001523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.039514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7214a5aa-dd18-41df-adb1-8d247b8a8faa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.060018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-199b5b93-c035-4419-afec-f865a54848af None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.095308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.096619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.096619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.096619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.097226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:40.097534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.100645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.114127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 331/651] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:40.115689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.128046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.129003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.129293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.129571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.205163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.209329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.210912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.239144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9228daf1-a5df-4b9c-99b8-639ce7779445 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.278121 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.283652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.284439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.284820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.285216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.286207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:40.292219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.292219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.301481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 332/652] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:40.301481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.338950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 321/653] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:40.339832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.424704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9a869-23fa-4109-ac69-1a41f84d5e1e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.465793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.466780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.467164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.467541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.470683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.477766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.479517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:40.496333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:40.497316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:57:40.498405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:40.506854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 333/654] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/users/cinder => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:40.508259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.558172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0bce8-c030-430f-a422-b0e18a1b4ef3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.634858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.635663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.635963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.636238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.638785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6efe5da9-3668-4a89-890d-ee595b45c59b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.647388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.648818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:40.670014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:40.670982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:40.671867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:40.671867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:40.671867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:40.671867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:40.671867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 322/655] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:40.673096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.680657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.681827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.682396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.682888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.685156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.696987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.703316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:40.717823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:40.718801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:40.719712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:40.719712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:40.719712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:40.719712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:40.726228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 334/656] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:40.727842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.776339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8155e9fb-d703-48e4-a478-4592bb426738 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.781755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.811554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.812226 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.812511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.812793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.814467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:40.814580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.815977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.838156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 323/657] 10.222.0.20 () {56 vars in 1137 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:40.838156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.847252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0d66d9-8452-4438-b489-280a89a2b81d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.885375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.886521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.887035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.887528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.888469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:40.889066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.890666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.902955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:40.905418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 335/658] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:40.906500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:40.937526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02454577-19ed-47f4-8583-8bae71858f6a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:40.973100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:40.973728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:40.974015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:40.974335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:40.975067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:40.975376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:40.976866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:40.993809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 324/659] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:40.993809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.023297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c210d4d-aaac-4233-867c-04ae2fc353f5 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.031766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.061814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20e8f2-0562-49d9-8cc0-eeda5ce84742 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.062830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20e8f2-0562-49d9-8cc0-eeda5ce84742 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.063904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20e8f2-0562-49d9-8cc0-eeda5ce84742 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.064399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20e8f2-0562-49d9-8cc0-eeda5ce84742 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.091630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fc00dc-18aa-4e13-8924-250fa0c5a8c8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.121179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.130090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.131149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.135132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.135132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.136108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20e8f2-0562-49d9-8cc0-eeda5ce84742 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.137559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20e8f2-0562-49d9-8cc0-eeda5ce84742 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.139077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.140786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:41.156260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:41.157774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:41.158788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 325/660] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/users/neutron => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:41.159381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.246550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 336/661] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:40 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:41.246550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb90a-8b67-4f38-ab7c-4cdbba3a04bf None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.246550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb90a-8b67-4f38-ab7c-4cdbba3a04bf None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.246550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fbeb90a-8b67-4f38-ab7c-4cdbba3a04bf None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.246550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 337/662] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:41.246550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb90a-8b67-4f38-ab7c-4cdbba3a04bf None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.257214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.274376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4464b3aa-b4e8-407e-9b73-8cb587b07a0c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.313339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.314163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.314452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.314736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.321481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.322989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:41.336636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:41.337625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:41.338558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 326/663] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:41.339054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.366511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fbeb90a-8b67-4f38-ab7c-4cdbba3a04bf None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.397475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.401152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.401820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.402128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.402406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.403368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:41.403673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.405096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f3259c1-e13d-4ee3-a354-8662927ef722 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.424230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 338/664] 10.222.0.20 () {56 vars in 1139 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:41.425545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.425828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.426122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.442531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:41.443735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:41.455484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f4794c6-176e-4dab-b436-d110e0f306e4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.489529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.490366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.490645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.490928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.502182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.503678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.504708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.522051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 339/665] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:41.522051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:41.533044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:41.533957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:41.534907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:41.534907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:41.534907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:41.534907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:41.538188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 327/666] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:41.539027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.631228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa9af55a-3f59-4840-80f6-5a94024133c7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.652817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.657849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f89c2eb-6465-4afa-8778-fd783aab9440 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.666125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.666785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.671599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.671599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.671599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:41.671599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.671599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.682055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 340/667] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:41.682869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.699174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.700251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.700762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.701219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.740376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.775908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.777726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.789448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d4344e8-4346-4b9e-ba6e-123574bae420 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.827355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.828011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.828290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.828558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.829834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:41.830170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:41.831525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:41.843840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 341/668] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:41.844940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.881085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.885624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 328/669] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 347 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:41.886486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:41.953023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4e58256-1cc1-49ef-b805-5b3ef9f113ce None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:41.967735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:41.988277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:41.989353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:41.989641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:41.989918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:41.991093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5575b968-c6a5-4bb0-8aba-3cbea1735f65 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.000600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:42.009139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:42.010116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:42.010929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 342/670] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/roles/service => generated 85 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:42.011596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.031105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.031695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.032009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.032292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.033132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=62d81f5f899b4113a6a54f0712725656) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:42.033447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.034910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.040890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 329/671] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:41 2022] GET /identity/v3/role_assignments?user.id=62d81f5f899b4113a6a54f0712725656&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:42.041682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.115832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.152629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-128c7879-c206-46c5-b16c-424fb56d21c3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.181229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9078f17c-5cb2-4466-8f99-36edf5e3dea8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.192577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.194351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.194641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.194922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.203072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.204626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:42.219549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:42.220448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:42.221306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 343/672] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:42.221916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.228538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.229360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.229644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.229919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.241595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.243141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-8cdd9e72-1bf1-4f70-a51d-e39187bf6e6e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:42.261432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:42.262480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:42.263405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:42.263405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:42.263405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:42.263405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:42.263405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 330/673] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:42.265230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f604d-f15c-4e8a-ba46-ff4106c5d8f5 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.265230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f604d-f15c-4e8a-ba46-ff4106c5d8f5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.265397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad0f604d-f15c-4e8a-ba46-ff4106c5d8f5 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.267553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 331/674] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:42.267676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f604d-f15c-4e8a-ba46-ff4106c5d8f5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.268196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.335176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33469abe-4589-4202-82c6-ee1c8313f0c2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.372165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.372824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.373108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.373382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.374157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:42.374462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.376443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b3104b6-83c1-47ae-8d2f-35315e36c7c6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.383250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad0f604d-f15c-4e8a-ba46-ff4106c5d8f5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.389174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 344/675] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:42.389174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.389174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.389174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.402919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:42.404084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:42.404953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.424716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.425380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.428550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.428550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.428550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:42.428550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.428550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.440716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 332/676] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:42.441528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.481013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 345/677] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:42.481703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.514657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.560587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caac0bbf-f37a-4b12-af62-6a11c9913ccf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.597342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.598020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.598331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.598606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.599326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:42.599633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.601079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.603558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-952eb1ff-ab20-447a-bfb6-ca927f4750c6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.613798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 333/678] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:42.614855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.643425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.644212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.644673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.644791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.652460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.655533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.657510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:42.676692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:42.677785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:42.678791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:42.678791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:42.678791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:42.678791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:42.678791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 346/679] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:42.678791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.728611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5d03d4-49a7-453b-8bec-dc918db1c703 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.758317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.767603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.768315 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.772828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.772828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.772828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=ba635abc81fd47c6b680836c67eeeeea) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:42.772828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.772828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:42.784100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 334/680] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/role_assignments?user.id=ba635abc81fd47c6b680836c67eeeeea&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:42.784100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.787020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94190a7-d007-48b1-8331-5defb304111b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.828515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.830018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.830418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.830804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.843720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:42.852151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:42.853147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:42.854012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 347/681] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:42.854773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:42.930293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3665db3-d9e1-45b6-b6b1-ba2baa8afedc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.933245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:42.974516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b66c6cd-9103-4fad-9962-c273c0a99081 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:42.980701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:42.981702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:42.982188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:42.982608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:42.992199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:42.994351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:43.015829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:43.016818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 335/682] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:43.018211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.020736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.021646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.022159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.022720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.023753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:43.024265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.027255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.036498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.043649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 348/683] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:43.045984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.144022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fbf6e8-785f-4f39-ad5c-052bb8ff6d3d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.181834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.182642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.182977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.183258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.184106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:43.184414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.185783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.191620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346c7f3f-8726-41e2-a012-ef369751e5a0 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.195896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 336/684] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:43.196958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.226957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.238256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.238945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.247583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.247583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.247583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:43.247583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.247583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.259648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 349/685] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:43.260569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.315990 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dacd5bd-2368-4e28-aac4-587448eced35 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.343622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.352652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.356202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.356202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.356202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] PATH_INFO: `/v3/users/swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.362627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.364252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.374490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d1d2cf-cc6e-415c-b19f-2b7cf03d4228 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:43.379433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:43.380581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:43.381915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:43.389400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 337/686] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/users/swift => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:43.390422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.410518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.411488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.411772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.412410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.427226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.428663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:43.450337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:43.451235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:43.452341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:43.452341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:43.452341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:43.452341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:43.452341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 350/687] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:43.452619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.484894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.505319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-960cf7cb-71aa-4dce-8050-2d65287a976e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.558865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.559531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.559815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.560093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.560926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=6f78d8aba8a94343b33000d45c22fae8) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:43.561236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.563231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.572090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 338/688] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/role_assignments?user.id=6f78d8aba8a94343b33000d45c22fae8&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:43.572961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.587918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e4dce12-a2fc-4e9f-8335-e4dad85ea841 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.600112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.627348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.628460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.628979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.629469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.630586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:43.631437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.633626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.657727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 351/689] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:43.660156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.734308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673ee98b-8c37-43ef-91af-0ea7a3606e22 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.802864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.810389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.810691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.810982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.811738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:43.812044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:43.813480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:43.833587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 339/690] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:43.836844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:43.846672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.848730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64aa749b-29f0-4450-bc97-fad03bcb68f4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.896784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.902335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.902787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.903256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:43.949808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:43.952907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478b4146-ab99-47b5-bc42-6d9d8fba2160 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:43.995615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:43.996407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:43.996762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:43.997099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.000198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.002494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.006391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.008016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:44.023680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:44.024776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:44.026125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 340/691] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/users/nova => generated 82 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:44.031700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.125012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.157862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 352/692] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:43 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:44.168479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.170844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-194a2126-86c9-443c-8f55-7a0df571de83 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:44.221709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:44.222407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.222688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.222963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.223803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:44.224110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.225530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85f025-8f04-4802-ac1d-1a918f225afb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.245557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 341/693] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:44.247020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad333-1469-4b9f-8cff-25613e839665 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.247251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad333-1469-4b9f-8cff-25613e839665 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.247530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-778ad333-1469-4b9f-8cff-25613e839665 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.252781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 342/694] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:44.252781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad333-1469-4b9f-8cff-25613e839665 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.267946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.305232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80643c9c-936e-4de3-b1c7-b10aba04d4ae None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:44.340770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:44.341920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.342367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.342785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.354588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.356306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.367751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-778ad333-1469-4b9f-8cff-25613e839665 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-217a7165-d105-4151-9671-2555d1fecfc4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:44.375607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:44.377147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:44.378249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:44.378249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:44.378249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:44.378249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:44.380090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 353/695] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:44.381757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.382244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.382694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.397338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.401058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:44.402517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:44.414587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:44.416074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.416544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.416997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.494059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 354/696] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:44 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:44.494059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.530494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.532318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.570401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.621206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5204c2-9761-4fce-9848-57fdcb0d5914 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:44.643167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 343/697] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 393 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Jul 06 16:57:44.644282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.668520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:44.669372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.669719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.670121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.671165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:44.672067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.672175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.674811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.691571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 355/698] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:44.692522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.784399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7329f077-eb5e-4bb2-9de5-22f355c8388a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:44.820594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:44.821677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.822216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.822691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.824728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3217ed15-a412-4841-8b6a-8ea465c889f1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:44.834067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.835788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.837817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:44.854573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:44.855486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:44.856362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:44.856362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:44.856362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:44.856362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:44.863432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 344/699] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:44.863432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.868331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:44.869133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:44.869419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:44.869694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:44.886142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:44.887602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:44.914728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:44.915634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:44.916553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:44.916553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:44.916553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:44.916553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:44.918927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 356/700] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:44.920414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:44.967170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:44.990073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a41bdbb0-bf48-4092-8605-4de4924a5d8a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.031081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.032051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.032709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.033155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.040520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.042108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.049923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d10503b-81e4-493f-a222-d4a7b5378ff9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:45.057180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:45.058319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:45.059467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:45.061938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 345/701] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/projects/service => generated 88 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:45.062152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.090703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.091644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.091929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.092211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.093106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:45.093710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.095223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.108989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 357/702] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:45.109804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.135522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.198864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-465eac79-98a1-41f3-8162-e7ac19310c9f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.214129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf98c72b-ab06-4a3b-a7c7-38e894c3d13a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.236448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.237215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.237504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.237772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.238519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:45.238824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.240312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc4e09f-7832-412b-856e-182418640575 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.242754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.248742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.249407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.249681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.257842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.257842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:45.257842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.257842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.258282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 346/703] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:45.258282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfba3-8b01-4ffe-84d4-d23981b74e5f None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.258282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfba3-8b01-4ffe-84d4-d23981b74e5f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.258282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bcdfba3-8b01-4ffe-84d4-d23981b74e5f None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.258282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 347/704] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:45.258282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfba3-8b01-4ffe-84d4-d23981b74e5f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.271964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 358/705] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:45.272795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.361444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.363638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bcdfba3-8b01-4ffe-84d4-d23981b74e5f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.380206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9f6f2a-d0cc-41b3-aff5-723adfc4f3b3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.398997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.400265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.400265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.400884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.401191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.402657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.416781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.417576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.417861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.418174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.425493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.426954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-25414e53-f92b-40e8-a7fd-ecec125c48fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:45.441692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:45.442755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:45.443642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 359/706] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:45.444553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.444652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.444900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.461031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:45.462141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:45.486091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 348/707] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:57:45 2022] POST /identity/v3/users => generated 254 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:45.486091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.562796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.564468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 360/708] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:45.565567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.642945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22323d7-61f9-4868-ba0e-35fa5c952354 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.674756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.690282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.690507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.690635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.690915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.691757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=0d90c264ccd44a6e88ac202f4e6a4fde) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:45.692079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.693527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.706893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 349/709] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/role_assignments?user.id=0d90c264ccd44a6e88ac202f4e6a4fde&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:45.707431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.712392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af953bd6-a256-4508-91b4-fca3886cc726 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.768278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.769597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.769981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.770433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.771695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:45.771888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.773612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.792543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 361/710] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:45.799249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.855661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d662c7e1-fe1b-4d5d-925e-f9f7c9b3dcad None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.883639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.905236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.905738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.906021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.906329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.907552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:45.909085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:45.930625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:45.931637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:45.933020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 350/711] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:45.938397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014e907c-07f2-4998-909c-dd2322f477ea None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:45.938559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:45.990404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:45.995396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:45.996460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:45.997055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:45.997658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:45.999045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=45e533c543494ad2a9a294458fa79d14) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:46.000065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:46.002368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2371c347-48b2-4cdb-b97f-e7eab2d33027 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:46.014978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 362/712] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/role_assignments?user.id=45e533c543494ad2a9a294458fa79d14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:46.070787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee2264ae-28ff-435b-b00c-155eeae28ff6 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:46.095621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ddfd-ba8a-4193-a8be-9a7d4d68c729 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.098470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ddfd-ba8a-4193-a8be-9a7d4d68c729 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.098999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d9ddfd-ba8a-4193-a8be-9a7d4d68c729 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.100855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 363/713] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:46 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:57:46.106612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.106984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.107340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.118957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:46.120037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.120571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.121030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.121946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:46.122502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:46.124214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:46.129809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 351/714] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 6 16:57:45 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:46.129998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:46.133673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:46.136673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:46.195538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:46.222119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 364/715] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:46.246464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:46.266054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9fa05b1-bf2e-4e63-aaf7-ad65c637844b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:46.311987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:46.312971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.313993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.314539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.315403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:46.315861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:46.317439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:46.332710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 352/716] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 6 16:57:46 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:46.416514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c590c942-7597-4238-b4a1-d75246a82c9a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:46.454804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:46.469776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:46.470613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.483722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.483722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] PATH_INFO: `/v3/services/network` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.483722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:46.483722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:46.492360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:46.493549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:46.494425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 365/717] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:46 2022] GET /identity/v3/services/network => generated 88 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:46.499615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:46.627746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65acabaa-a376-4a63-befb-25c878ad51cf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:46.637163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:46.662788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:46.663459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.663743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.664021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.664738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] RBAC: Adding query filter params (name=network) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:46.665045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:46.666449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f79d466b-77b1-4da4-aa99-8f1079e10d97 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:46.671284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 353/718] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:57:46 2022] GET /identity/v3/services?name=network => generated 124 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:46.679102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:46.824979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b956c9-7eb1-4767-a60a-25621d151e59 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:46.880309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:46.881237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:46.881518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:46.881793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:46.882540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] RBAC: Adding query filter params (type=network) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:46.882845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:46.884231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7424cf4f-1680-4648-ab36-7bb538c41846 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:46.894850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 366/719] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:57:46 2022] GET /identity/v3/services?type=network => generated 124 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:48.069136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e63fb9-01e1-4a8a-a2e3-6382d940ef15 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.069651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e63fb9-01e1-4a8a-a2e3-6382d940ef15 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.069730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16e63fb9-01e1-4a8a-a2e3-6382d940ef15 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.071332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 354/720] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:48.076370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.076785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.076971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.094543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:48.095720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:48.153984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:48.172096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 367/721] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:48.197320 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e63fb9-01e1-4a8a-a2e3-6382d940ef15 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:48.299230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16e63fb9-01e1-4a8a-a2e3-6382d940ef15 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:48.350486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bc08c8-d670-450d-8921-bf2c1a4eb090 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:48.350486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc08c8-d670-450d-8921-bf2c1a4eb090 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.350486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc08c8-d670-450d-8921-bf2c1a4eb090 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.350486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bc08c8-d670-450d-8921-bf2c1a4eb090 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.361669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bc08c8-d670-450d-8921-bf2c1a4eb090 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-71bc08c8-d670-450d-8921-bf2c1a4eb090 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:48.377398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:48.378389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:48.379222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:48.381867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 355/722] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:48.388046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:48.480632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840ddc-f01a-40b1-a13e-c472c16e8b67 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.480958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840ddc-f01a-40b1-a13e-c472c16e8b67 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.481198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d840ddc-f01a-40b1-a13e-c472c16e8b67 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.482824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 356/723] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:48.488511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.488792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.489066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.506715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:48.507880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:48.538392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:48.579974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 357/724] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Jul 06 16:57:48.580168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eb4abc4-1df8-4781-a56b-464b5bfb5d8c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:48.602919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:48.646723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:48.647398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.647682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.648060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.648819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:48.649126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:48.650789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:48.669087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 368/725] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:48.675268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:48.705795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42e00a60-d37c-4fe6-acc1-2f639587c9dd None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:48.740788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:48.743166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdca5a7-48e8-4929-acad-acffa12df82e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:48.743964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca5a7-48e8-4929-acad-acffa12df82e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.744243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca5a7-48e8-4929-acad-acffa12df82e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.744524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdca5a7-48e8-4929-acad-acffa12df82e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.755540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdca5a7-48e8-4929-acad-acffa12df82e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-9fdca5a7-48e8-4929-acad-acffa12df82e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:48.769221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:48.770214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:48.771516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 358/726] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/roles/admin => generated 83 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:48.773341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c5d3c-00c7-46f3-8b38-1d3747f0c6e7 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.773341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c5d3c-00c7-46f3-8b38-1d3747f0c6e7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.773341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567c5d3c-00c7-46f3-8b38-1d3747f0c6e7 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.778693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 359/727] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:48 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:48.779477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c5d3c-00c7-46f3-8b38-1d3747f0c6e7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:48.797867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee699e6f-7df4-4f9d-9fe2-534c62b457a2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:48.806983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:48.834722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17364913-675e-4578-aab0-246fe87350bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:48.835789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364913-675e-4578-aab0-246fe87350bc None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.836226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364913-675e-4578-aab0-246fe87350bc None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.836651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17364913-675e-4578-aab0-246fe87350bc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.848853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17364913-675e-4578-aab0-246fe87350bc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:48.850561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17364913-675e-4578-aab0-246fe87350bc None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-17364913-675e-4578-aab0-246fe87350bc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:48.869827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:48.870942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:48.872015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:48.872015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:48.872015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:48.872015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:48.873864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 369/728] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:48.875427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b1a8-e137-42c3-b0a5-a8dda8b45b92 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.876461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b1a8-e137-42c3-b0a5-a8dda8b45b92 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.876939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac4b1a8-e137-42c3-b0a5-a8dda8b45b92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.889429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567c5d3c-00c7-46f3-8b38-1d3747f0c6e7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:48.895974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4ac4b1a8-e137-42c3-b0a5-a8dda8b45b92 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:48.897422 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4ac4b1a8-e137-42c3-b0a5-a8dda8b45b92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:48.928833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:48.929507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.929790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.930081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.930942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:48.931251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:48.932771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:48.944870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 360/729] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:48.945794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:48.970614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 370/730] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:48.971975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36aae-a3e3-418f-96ab-fddda198c3da None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:48.972250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36aae-a3e3-418f-96ab-fddda198c3da None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:48.972523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d36aae-a3e3-418f-96ab-fddda198c3da None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:48.973871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 371/731] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:48.974454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d36aae-a3e3-418f-96ab-fddda198c3da None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.010958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.041501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.058889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ed304ac-cbff-41ed-99fe-811540c670bb None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.089401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d36aae-a3e3-418f-96ab-fddda198c3da None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.099347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.100010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.100596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.100876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.101746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:49.102076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.103433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce3d7c83-83b3-47f8-b7c8-2b6437b3cb00 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.120098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 361/732] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:49.120098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.120098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.120098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.131542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.132433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.132714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.132988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.134364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:49.135544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:49.144373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.145807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:49.163415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:49.164358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:49.165305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:49.165305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:49.165305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:49.165305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:49.165305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 372/733] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:49.165602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.209872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 362/734] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:49.219601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.258852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.277365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8ad9de-e236-411a-ae1e-40b7286b8ef9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.302162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.311895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.312688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.312974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.313835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.324723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:49.327729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d20ad35d-28c5-444f-96e9-178b5bc6d5f3 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:49.332400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:49.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 373/735] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:49.339223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.363118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.364044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.364339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.364622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.372705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.374109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:49.389036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:49.390117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:49.391050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 363/736] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:49.391690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.452850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c2b941-3b44-4e02-8b32-4c039a7b3490 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.489382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.490328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.490706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.491111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.491860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:49.492356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.493883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.495917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-909c76e8-af0c-42ae-8eb1-3406aa804d99 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.503982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.512386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 374/737] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:49.512386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.535765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.536512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.536797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.537071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.537788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.539190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.541391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.607746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a62bbafe-d6dc-4006-b82a-709c5633eea2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.617497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 364/738] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:57:49 2022] POST /identity/v3/services => generated 251 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:49.618411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.674754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.675483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.675832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.676176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.677017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:49.677390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.679000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.693555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 375/739] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:49.693555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.741246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50489ea7-5f0f-45cf-9d99-7a82658a47ce None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.754359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.780244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.780921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.781202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.782753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.782928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:49.783242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.784736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b69f214d-877e-43c2-9ffe-6f503d74135a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.803803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c80e7c6-345f-4073-be5a-d96c5807f9cb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.804873 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 365/740] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:49.806316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf99ea-1127-4fe6-b5ba-d84417085b1f None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.807508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf99ea-1127-4fe6-b5ba-d84417085b1f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.807794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6bf99ea-1127-4fe6-b5ba-d84417085b1f None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.809210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 366/741] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:49.813320 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf99ea-1127-4fe6-b5ba-d84417085b1f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.840254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.841038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.841318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.841602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] PATH_INFO: `/v3/users/nova` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.849479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.851078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:49.865371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:49.866534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:49.867654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:49.871187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 376/742] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:49.872016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:49.879020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:49.933847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6bf99ea-1127-4fe6-b5ba-d84417085b1f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.970404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:49.971379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:49.971789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:49.972205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:49.977853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c321460-add6-4b36-bc72-5c2115333e3c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:49.983584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:49.985044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:49.995930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-a512bc04-c2a8-4c51-8c75-09f16fe7c3ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:50.004592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:50.011506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 367/743] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.012595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.020774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.021499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.021886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.022286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.099426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.100992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.142392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:50.143591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:50.218140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 368/744] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:50 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Jul 06 16:57:50.218140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.218383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 377/745] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:49 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 345 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Jul 06 16:57:50.218383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.238653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.254201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.324899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e17e9a0-3de2-444a-be09-0640861b52bb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.325099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b45fd6-0ab9-417a-999e-01ddcbfc90fa None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.360688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.361520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.361806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.362108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.362209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.362796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.362956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:50.363109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.363276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.363369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.364059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:50.364368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.364686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.365737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.382640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 378/746] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:50.382640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.387560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 369/747] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:50.388511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.466978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.483185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.490736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ce81f4e-a8d2-48cd-84fb-6c461a238a3c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.491999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3c1300-3372-4770-8c8f-e01ad4ca456c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.525029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.525686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.525965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.526270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.526558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.527015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.527348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.527635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.527912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.528446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.538767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.540205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:50.557746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:50.558855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:50.565036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:50.565036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:50.565036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:50.565036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:50.565036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 379/748] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:50.565036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.603241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 370/749] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:57:50 2022] POST /identity/v3/services => generated 240 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:50.615148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.672128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5379f22a-05e4-4294-85ac-5ebab814fb30 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.718418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.730240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.731293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.732403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.738322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.745134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.746978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:50.767769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:50.772396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:50.773619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:50.774280 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8573748f-59b3-474c-af4d-9270e19bd7c1 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.774361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 380/750] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/users/swift => generated 83 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:50.774929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.843465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.844279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.844560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.844891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.858933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.862194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:50.884577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:50.885555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:50.886525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:50.886525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:50.886525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:50.886525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:50.888764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 371/751] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:50.894506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:50.899428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:50.925355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d2a2ac-c7fa-4b16-8f3d-5d2191878cec None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:50.971531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:50.972194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:50.972477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:50.972754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:50.973476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:50.973780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:50.975183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:50.991650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 381/752] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:50.992711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.009905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82176356-d676-485b-a824-3443142d8ea1 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.044438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.056016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.057636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.058270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.059749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.060790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:51.061938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.064683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.084922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 372/753] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:51.086256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.124018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3883716a-4703-4cf1-a764-cb3e0fdc66a4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.152518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.169287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.169961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.170252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.170527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.171608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:51.171919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.174138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.193881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 382/754] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:51.193881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.202410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980f9b2b-56ed-4242-bab3-2a03d940ec10 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.238274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.239494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.239983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.240480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.248257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.249988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:51.266294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:51.267292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:51.268194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:51.270729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 373/755] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:51.271863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.322742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40f34cab-be77-4220-bf8e-69c90f040038 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.332170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.369503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.370205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.370488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.370759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.389514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7180567a-5976-4ca3-89d5-384529754e73 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.417680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.433404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.434227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.434502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.434779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.444911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.446641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.455655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.457443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:51.463753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:51.464661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:51.465560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:51.470220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 374/756] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/projects/service => generated 88 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:51.471055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.584773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 383/757] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:57:51.585984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.596735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.604585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8afbc89-774d-4db7-8187-fc013a79a5ea None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.642542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.643539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.644029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.644607 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.645752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:51.646287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.648036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.662687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 375/758] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:51.663963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.705487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6b41e7-ab16-4209-8f69-c5f17b20560e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.718303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.745247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.745929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.746521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.749605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.749605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:51.749605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.750404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.768014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 384/759] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:51.768884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.782997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48cfdb24-7d10-4ec5-92c5-02b2434086b3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.818319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.819110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.819390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.819662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.829518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.831010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.836415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-2f94dd1d-3641-4016-9ee5-6d95b5098239 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:51.848533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:51.857358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 376/760] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3865-1e1c-4846-bbd5-ff79a73c2c54 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3865-1e1c-4846-bbd5-ff79a73c2c54 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7d3865-1e1c-4846-bbd5-ff79a73c2c54 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.858515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 377/761] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:51.859127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3865-1e1c-4846-bbd5-ff79a73c2c54 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.883398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb04117-8d60-4fbb-85fe-7ace344b0280 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:51.918569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:51.919287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:51.919570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:51.919841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:51.920662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=bf1272ce812546ce8536a7fab6078c14) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:51.920974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:51.923172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:51.938058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 385/762] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/role_assignments?user.id=bf1272ce812546ce8536a7fab6078c14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:51.938058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:51.959418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:51.967414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7d3865-1e1c-4846-bbd5-ff79a73c2c54 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.007348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce424c6-3853-4272-9489-85e9ea9d7a67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.008393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce424c6-3853-4272-9489-85e9ea9d7a67 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.008747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce424c6-3853-4272-9489-85e9ea9d7a67 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.009096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce424c6-3853-4272-9489-85e9ea9d7a67 None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/45e533c543494ad2a9a294458fa79d14/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.011274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce424c6-3853-4272-9489-85e9ea9d7a67 None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=45e533c543494ad2a9a294458fa79d14, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.012869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce424c6-3853-4272-9489-85e9ea9d7a67 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.056063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc4d80f-db08-4d08-a695-46c9acaaf4dd None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.085267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 378/763] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:51 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/45e533c543494ad2a9a294458fa79d14/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:52.086932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.087328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.087817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.094199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:52.112723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.113724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.114176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.114584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.115536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:52.115947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.120365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.125993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:52.127192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:52.144011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 386/764] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:52.149646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.232811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 379/765] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:52.263516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.292996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8765c5e-7c3f-4096-a89f-6bc61585042b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.331331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.332174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.332453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.332728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.340742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.342151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:52.357081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:52.358004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:52.358943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 387/766] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:52.364306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.376518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:52.398681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa459a76-a421-4c68-924b-078b8f81ebe5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.425336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:52.435698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.436863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.437347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.437823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.439255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.440913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:52.456007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:52.462737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:52.463561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 380/767] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:52.466851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.479483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac26a92-7381-4473-85b4-28565d3e5578 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.515464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3754-4150-460a-b317-310a32260376 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.516828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3754-4150-460a-b317-310a32260376 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.517115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3754-4150-460a-b317-310a32260376 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.517385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046d3754-4150-460a-b317-310a32260376 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.518194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d3754-4150-460a-b317-310a32260376 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:52.518498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d3754-4150-460a-b317-310a32260376 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.520223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046d3754-4150-460a-b317-310a32260376 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.533022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 388/768] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:52.538820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3754-4150-460a-b317-310a32260376 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.578049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6fc3d4-61f5-4aa2-b452-42b75f359e9b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.614684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.615703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.616186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.616683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.617591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:52.618118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.619710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.625211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 381/769] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:52.631646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.645136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046d3754-4150-460a-b317-310a32260376 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.647637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:52.656483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:52.681161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.681818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.682128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.682450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.683429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=0d90c264ccd44a6e88ac202f4e6a4fde) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:52.683695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.685168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d58a4244-e8f8-404e-8d5f-8bdc8480d41e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.691762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 389/770] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/role_assignments?user.id=0d90c264ccd44a6e88ac202f4e6a4fde&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:52.747712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d67fdc1-7065-44de-8f2a-16cfc5cd24d3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.796665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.798413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.798546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0971e-f553-42b7-9d43-e508ac89d70f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.798727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.798839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0971e-f553-42b7-9d43-e508ac89d70f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.798990 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.799093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16f0971e-f553-42b7-9d43-e508ac89d70f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.799676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:52.799982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.800601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 390/771] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:52.801370 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:52.806302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.806589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.806866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.807347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 382/772] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:52.812917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.836774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:52.837971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:52.914546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:52.928053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 391/773] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:52 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:52.938888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e32bea5-8d62-4c72-b660-f9d00e6ec111 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:52.965128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:52.983571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:52.984345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:52.984637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:52.985462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:52.986288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] RBAC: Adding query filter params (interface=public, service_id=2e797f936aae4ab784bfe793a3716eb5, region_id=RegionOne) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:52.986599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:52.988087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.002680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 383/774] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/endpoints?service_id=2e797f936aae4ab784bfe793a3716eb5&interface=public®ion_id=RegionOne => generated 194 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:53.008179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:53.069710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1638032-ca62-4b40-9df0-6ce6de6dd180 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:53.072110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:53.109199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:53.110588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:53.110870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:53.111143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] PATH_INFO: `/v3/services/network` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:53.111801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:53.113166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:53.138564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:53.139618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:53.140447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:53.146472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 392/775] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:52 2022] GET /identity/v3/services/network => generated 88 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:53.152668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:53.175068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1eea6bd-4b36-4c63-9313-6c88ec7377c8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:53.227023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:53.228053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:53.228556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:53.229233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:53.231215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:53.233041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.242924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 384/776] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:57:53 2022] GET /identity/v3/services => generated 772 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:53.325868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0981dc2-e7a3-4442-b86f-8968c80fa78b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:53.375018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:53.376145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:53.376628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:53.377142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:53.378093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] RBAC: Adding query filter params (name=network) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:53.378653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:53.380632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.386650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 393/777] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:57:53 2022] GET /identity/v3/services?name=network => generated 124 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:53.394772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:53.398853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:53.501143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d25faee4-8728-4ae1-837b-fe698ab22eff None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:53.558608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:53.559295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:53.559579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:53.559855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:53.560579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] RBAC: Adding query filter params (type=network) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:53.560886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:53.562336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.574826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 385/778] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:57:53 2022] GET /identity/v3/services?type=network => generated 350 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:53.580717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:53.621978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:53.693833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d629b7-bccf-409d-b8d7-db4b07df01c3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:53.729213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:53.734624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:53.734624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:53.734624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:53.734624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] RBAC: Adding query filter params (interface=public, service_id=f62d9bfcd48547d4be5b3bcc79a64aa2, region_id=RegionOne) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:53.734624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:53.734624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf2c464e-0a26-48ed-9fba-aa40711d42b4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.741864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 394/779] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:57:53 2022] GET /identity/v3/endpoints?service_id=f62d9bfcd48547d4be5b3bcc79a64aa2&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:53.749289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:53.850554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:53.875061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90c3888b-8c6a-42d9-9e89-1c9c532e7004 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:53.911491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f0b204-7be0-42c1-8ab7-761634a6aada None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:53.912262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b204-7be0-42c1-8ab7-761634a6aada None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:53.912546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b204-7be0-42c1-8ab7-761634a6aada None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:53.912825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f0b204-7be0-42c1-8ab7-761634a6aada None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:53.913511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0b204-7be0-42c1-8ab7-761634a6aada None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:53.914915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f0b204-7be0-42c1-8ab7-761634a6aada None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:53.920343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 386/780] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:57:53 2022] GET /identity/v3/services => generated 772 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:54.609606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477c68-b921-4f91-8c91-9508f64a1e0f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:54.610713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477c68-b921-4f91-8c91-9508f64a1e0f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:54.610713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7477c68-b921-4f91-8c91-9508f64a1e0f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:54.612218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 395/781] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:54.617568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:54.618414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:54.618901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:54.636229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:54.637732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:54.659820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18733a2-34c3-4cbe-b10f-dc24171d1a26 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:54.660139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18733a2-34c3-4cbe-b10f-dc24171d1a26 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:54.660394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18733a2-34c3-4cbe-b10f-dc24171d1a26 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:54.662045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 396/782] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:54.666536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:54.666824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:54.667102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:54.696837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:54.698052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:54.710237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 387/783] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:54.734066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:54.819032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 397/784] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:54 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:54.846471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:54.875701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:54.898401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:54.962322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8daedbc0-9d80-412f-9e1d-6b55363165cf None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:54.991937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8301de59-61bc-43e9-bd7d-ba16f2e446e4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:54.999453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.000255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.000575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.000858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.016999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:55.035056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:55.036096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:57:55.036961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:55.038107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 398/785] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:57:54 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:55.054309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.055156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.055442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.055793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.067318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.078108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:55.090946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:55.091880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:55.092727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:55.096102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 388/786] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:55.102105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.190396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:55.202671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f6bea4-b8c9-450b-92ad-619a199aaf2c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.240400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.241073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.241358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.241638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.242429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:55.242878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.244685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.254429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 399/787] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:55.259811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.319117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab66508-dbf8-41fb-bf99-de58f24ae64f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.348036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:55.365358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.366415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.367184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.367754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.368786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:55.369475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.371304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e997cc-3242-47f8-8cc2-8c718a5796c9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.384110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 389/788] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:57:55.385598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814de0-872c-490b-9917-708cb35a79ee None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.386051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814de0-872c-490b-9917-708cb35a79ee None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.386470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab814de0-872c-490b-9917-708cb35a79ee None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.388050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 390/789] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:55.389739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab814de0-872c-490b-9917-708cb35a79ee None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.396106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1532f4a1-cb55-4f04-8372-87508508e7f2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.431982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.432934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.433223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.433532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.445477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.447017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.458720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-9c9318e3-7f83-4b1b-8043-ef3b11ce6f6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:55.468404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:55.469516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:55.470625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:55.470625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:55.470625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:55.470625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:55.474513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 400/790] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:55.479131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.479131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.479131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.495674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:55.497028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:55.518416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab814de0-872c-490b-9917-708cb35a79ee None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.561335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.562516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.563872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.564310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.576720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.578459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.581178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 401/791] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:55 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:55.582311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:55.598643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:55.599667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:55.600551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:55.600551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:55.600551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:55.600551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:55.602858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 391/792] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:57:55.608172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.647775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:55.706118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcc2f4b-b9b9-4611-ae1d-b99a05e15854 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.714476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49783c69-ed7f-4b4c-b693-f110bcac15c7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.742550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:55.746956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.747632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.747918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.748196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.748927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:55.749222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.751334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.752822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.753710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.754223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.754706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.763234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:55.763234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.763234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.768755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 402/793] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:55.769812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.770500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 392/794] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:55.771557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.869302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:55.875117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be2929f-c419-4314-8f22-58f38ef4817c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.878138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5c85af-6537-4dc1-bc2d-8ad97e30a66a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:55.911979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.912959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.913337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.913702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.914237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88cf9813-b549-4a15-8d69-a805b5ff1e06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:55.915034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf9813-b549-4a15-8d69-a805b5ff1e06 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.915318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf9813-b549-4a15-8d69-a805b5ff1e06 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.915598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88cf9813-b549-4a15-8d69-a805b5ff1e06 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.922151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:55.924617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:55.926596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88cf9813-b549-4a15-8d69-a805b5ff1e06 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-88cf9813-b549-4a15-8d69-a805b5ff1e06 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:57:55.934129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:55.935205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:55.936069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 403/795] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:55.936940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916632-232a-41f7-a20e-0e101e6c924c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:55.937234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916632-232a-41f7-a20e-0e101e6c924c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:55.937514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed916632-232a-41f7-a20e-0e101e6c924c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:55.939604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 404/796] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:55.940315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed916632-232a-41f7-a20e-0e101e6c924c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:55.943659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:55.944768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:57:55.945705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:55.947688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 393/797] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:55.948579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:55.995512 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.047014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed916632-232a-41f7-a20e-0e101e6c924c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.056157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7d39cfb-e8f8-449b-ac6a-8c7d0e658158 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.083608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.084626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.085069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.085341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.092873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.094884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.094995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.095591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.095934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.096216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.097615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:56.097948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.099511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd0ab90-c78d-494d-8232-9da71ff19025 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.113206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 394/798] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:56.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:56.114282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:57:56.115213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:56.115736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.115736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.115868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 405/799] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:57:55 2022] GET /identity/v3/users/nova => generated 82 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:56.115868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.115995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.135098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:56.136575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:56.155438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.214107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 395/800] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:56.215151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.227689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd27967-c871-4bf3-90e9-6eda35dc89d4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.239692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.264575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.265249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.265531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.265810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.266742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:56.267052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.268486 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.287305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 406/801] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:56.288159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.331412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089775c7-a609-40ed-b949-b84a209e6721 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.367507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.368297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.368577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.368853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.379001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.380439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.389108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.394981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b153e27a-65a4-4393-8a90-69e7c4306cf3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:56.398900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:56.405680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:56.406638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:56.406638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:56.406638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:56.406638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:56.406638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 396/802] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:56.406638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.513135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672a4916-aa9b-428d-8d90-bd9609979c2b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.544523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.545192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.545477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.545850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.546711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:56.546980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.547353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.548153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.548431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.548525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.548699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.549341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.550713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:56.562576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:56.563507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:56.564359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 397/803] 10.222.0.20 () {56 vars in 1129 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:56.565714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.569868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 407/804] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:56.570667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.597899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.628519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.666489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8f3f70-78ca-467b-8ccc-86aad6d84c83 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.667644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3016f192-a669-4b83-ba8c-25c61cbfacea None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.699979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.700527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.700653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.700886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.701157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.701308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.701587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.701860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:56.701967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.702206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.704149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc2a07a-be24-4a77-9439-b27400135d3d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.712958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.714367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.715000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 408/805] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:56.716225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40245-a7fd-4c18-bdc4-05b29458b543 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.716512 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40245-a7fd-4c18-bdc4-05b29458b543 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.716795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff40245-a7fd-4c18-bdc4-05b29458b543 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.718175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 409/806] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:56 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:56.718705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40245-a7fd-4c18-bdc4-05b29458b543 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:56.733802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:56.734934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:56.735863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:56.735863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:56.735863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:56.735863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:56.735863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 398/807] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:56.736138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.807131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.822905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff40245-a7fd-4c18-bdc4-05b29458b543 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.835934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a6aecb-0b3c-4194-b93a-e436034acb3e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.851414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:56.856711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.857368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.857651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.857985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.858721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:56.859025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.860463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.865182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 410/808] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:56.866178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:56.868764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.869407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.869691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.870247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:56.936450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:56.937806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:56.963789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a29e4a-8015-434f-a14d-249f737260ed None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:56.996045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:56.996824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:56.997109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:56.997386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.004761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.006548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-2df78c5c-1114-4b8d-8878-787e23f50619 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:57:57.021552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:57.022704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 411/809] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/users/swift => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:57.023943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.024725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.024725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.039029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 399/810] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:57:56 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:57:57.039857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.040556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:57.041731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:57.045376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.058503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.108437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 412/811] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:57.109264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.142685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368039b5-154e-484b-a8a7-dfb70194489c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.177141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.177797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.178113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.178391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.179114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:57.179416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.180772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.192371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 400/812] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:57.193078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.207160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74afb2b2-5223-4e6f-b596-d12e6437266a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.241518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.242204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.242486 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.242759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.243456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:57.243758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.245143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.249910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 413/813] 10.222.0.20 () {56 vars in 1124 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:57.251186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.254470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.272211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.293810 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ca97ee-57ee-4fb7-bcc7-4cfb2d5c3539 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.328659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.329329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.329611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.329889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.330779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:57.331083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.332503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.346671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90809a8b-6b4b-46c0-b846-715cbf76f17e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.349076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 401/814] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:57.349933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.381098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.381868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.382180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.382453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.392202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.393635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:57.410377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:57.411294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:57.412416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:57.412416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:57.412416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:57.412416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:57.412416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 414/815] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:57.412849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.447269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cfccb9-f4fd-4c67-b6ab-ca2e795bea74 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.470154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.481307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.482124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.482404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.482676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] PATH_INFO: `/v3/services/network` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.483318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.484677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.487328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:57.497408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:57.498455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:57.499301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 402/816] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/services/network => generated 88 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:57.501507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.514412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68716a37-828d-463e-9d8a-0e2bd5202a59 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.547973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.548754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.549034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.549307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.556774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.558253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:57.572328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:57.573382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:57.574499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 415/817] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:57.575085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.607952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45bc9b76-2a68-476c-81cc-6cc5cf64fc62 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.640604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.641271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.641552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.641837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.642600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.643956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.670928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b352a3-9d5b-41ad-b936-c706fb1f41b4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.686772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.703671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.704394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.704679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.704958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.715062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.716525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.728535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 403/818] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:57:57 2022] POST /identity/v3/endpoints => generated 346 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:57.729350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:57:57.735419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:57.736540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:57.737476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:57:57.737476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:57:57.737476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:57:57.737476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:57:57.737476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 416/819] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:57.737763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.812883 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:57.855850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f4be78-94dc-4891-8109-8c03f582bfe3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.872727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-795d5d2f-ef84-48bf-9d38-2876e245f423 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:57.895682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.896402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.896691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.896963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.897654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] RBAC: Adding query filter params (name=network) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:57.897961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.899346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.904787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 417/820] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/services?name=network => generated 124 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:57.905561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.912592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:57.913279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:57.913542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:57.913818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:57.914595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:57.914901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:57.916723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:57.932510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 404/821] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:57.933652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:57.942207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.021966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75f1a83-8284-40fc-b4b8-53900a0fbd9e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.039652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-351ab705-2c54-4895-86ec-631b6eb03a3f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.052241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.056013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.056678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.056955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.057201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.057981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:58.058309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.059742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.072302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 418/822] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:58.075521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.076184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.076469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.076958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.077554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:58.077674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.077866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.079794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.092984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 405/823] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:57:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:58.096002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.177762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.187364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88bc3be2-22f3-432e-bee2-6ab3a144417e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.200561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16621c9f-0665-4e77-a3cf-23e570847e10 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.225769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.226713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.226987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.227269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.227955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] RBAC: Adding query filter params (type=network) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:58.228302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.229605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.234395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 419/824] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:57:58 2022] GET /identity/v3/services?type=network => generated 350 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:58.235155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.242120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.243002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.243290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.243567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.250952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.252407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:58.267304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:58.268235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:58.269119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 406/825] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:58.270279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.301850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.347171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d5326a-1c72-4992-87b7-c639742dca17 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.373781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54c590e1-905b-4dc2-a6b6-82399058e95f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.381553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.382478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.382762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.383040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/bf1272ce812546ce8536a7fab6078c14/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.398513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=bf1272ce812546ce8536a7fab6078c14, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.399940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.409301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.410121 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.410416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.410695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.417354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.418861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:57:58.432959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:57:58.434001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:57:58.435080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 407/826] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:57:58 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:57:58.435617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.482067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 420/827] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:58 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/bf1272ce812546ce8536a7fab6078c14/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:58.482067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.489116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.560793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.572081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-177896a1-a23e-4527-866b-0a7ee748cfab None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.612306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.612807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.613095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.613373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.614162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.615714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.630961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f03631a-d101-4d88-bf6f-2744881b123f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.670784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.671821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.672875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.673359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.674406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:58.674925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.676554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.689227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 421/828] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:58.690352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.705451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 408/829] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:57:58 2022] POST /identity/v3/endpoints => generated 327 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:57:58.711873 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.772124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:58.815386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab20ba40-a9fe-472a-b37e-e77b2e503f90 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.861929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.862158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be211632-172e-4ed9-b1c0-99fabad778d7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:58.863468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.864100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.864707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.865705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:58.866245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.867997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.883988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 422/830] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:57:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:58.897834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:58.918257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:58.918940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:58.919228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:58.919512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:58.920478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=45e533c543494ad2a9a294458fa79d14) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:57:58.920801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:58.922827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a781ab41-8842-4874-ba9a-1b5e970e55d7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:58.940374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 409/831] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:57:58 2022] GET /identity/v3/role_assignments?user.id=45e533c543494ad2a9a294458fa79d14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:57:59.034914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d17ef9-578c-488a-8c91-f34338d09830 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:57:59.062185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:57:59.079828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9cbd2c2-87f2-4bdb-9dd6-d01a10609ff2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:57:59.080719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd2c2-87f2-4bdb-9dd6-d01a10609ff2 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:59.081001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd2c2-87f2-4bdb-9dd6-d01a10609ff2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:59.081280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9cbd2c2-87f2-4bdb-9dd6-d01a10609ff2 None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/0d90c264ccd44a6e88ac202f4e6a4fde/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:59.085965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbd2c2-87f2-4bdb-9dd6-d01a10609ff2 None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=0d90c264ccd44a6e88ac202f4e6a4fde, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:57:59.087535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9cbd2c2-87f2-4bdb-9dd6-d01a10609ff2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:57:59.177757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 423/832] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:57:58 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/0d90c264ccd44a6e88ac202f4e6a4fde/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:57:59.838134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3895c-1c10-4d3d-ae6f-bb7c1bae12c7 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:59.838569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3895c-1c10-4d3d-ae6f-bb7c1bae12c7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:59.838771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c3895c-1c10-4d3d-ae6f-bb7c1bae12c7 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:59.840291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 410/833] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:57:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:57:59.845537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:57:59.845970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:57:59.846175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:57:59.862938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:57:59.864111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:57:59.931886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 424/834] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:57:59 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:57:59.954696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3895c-1c10-4d3d-ae6f-bb7c1bae12c7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:57:59.963855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:00.058411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c3895c-1c10-4d3d-ae6f-bb7c1bae12c7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:00.094170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:00.094958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:00.095244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:00.095574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:00.096229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:00.097599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:00.109601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:00.110658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:00.111888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 411/835] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:57:59 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:00.117082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:00.223884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e35fed88-c4d2-44fd-8769-a02e8368317e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:00.238140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:00.260975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:00.261648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:00.261936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:00.262246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:00.262954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:00.263260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:00.264682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f653ab99-92a4-4178-85f2-8c14105464c5 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:00.269861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 425/836] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:00 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:00.275318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:00.348759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:00.383843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417af25f-34c5-40b0-abb7-ca53b47a6bb4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:00.417871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:00.418565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:00.418850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:00.419128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:00.419884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:00.420194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:00.421688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13de7502-e2dc-48c0-ad36-b3970435a9b2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:00.427364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 412/837] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:00 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:00.594775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9825ce-1c29-41e6-8939-4942e3d71e0e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:00.595224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9825ce-1c29-41e6-8939-4942e3d71e0e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:00.595508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9825ce-1c29-41e6-8939-4942e3d71e0e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:00.597014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 426/838] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:00.602164 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:00.602701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:00.603206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:00.624513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:00.625747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:00.695621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 413/839] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:00 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:00.718223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9825ce-1c29-41e6-8939-4942e3d71e0e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:00.829697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9825ce-1c29-41e6-8939-4942e3d71e0e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:00.866420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:00.870972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:00.871417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:00.871830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:00.883464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:00.891428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:00.892555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 16:58:00.893598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:00.896006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 427/840] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 16:58:00 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:00.903502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:00.966061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.005371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb55ca2f-0004-4805-a52a-926d18e4eed5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.040545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.041213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.041496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.041772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.042547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:01.042851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.044213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be061ed-5f8d-49dd-b5fe-6d35714c4b0d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.052861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 414/841] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 16:58:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:01.058301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.098580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.168536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2533445-34e1-482a-9ab4-e06dbadca48c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.169561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fc07-e43b-4d57-b78c-0a97b5e4e2ba None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.169863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fc07-e43b-4d57-b78c-0a97b5e4e2ba None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.170187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c883fc07-e43b-4d57-b78c-0a97b5e4e2ba None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.171723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 415/842] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:01.177403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.177700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.177984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.197435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:01.198676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:01.216792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.218706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.219765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.220491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.235124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.237523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:01.259832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:01.260763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:01.261814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:01.261814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:01.261814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:01.261814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:01.261814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 428/843] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:01.267423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.281481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 416/844] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:01.303550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.363024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.374449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.387008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b6aacb9-c657-4541-828a-5cba2cbb9501 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.411424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196c529b-2d75-4508-8d02-31fa2160634b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.420325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.420923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.421208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.421485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.422261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:01.422569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.423968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53d2e33a-9ae5-40d0-a35a-1a44af00b9ac None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.435997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 429/845] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:01.437501 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cbd4c-2e74-4a4a-8fad-f4bb50dd160c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.438330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cbd4c-2e74-4a4a-8fad-f4bb50dd160c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.438642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-684cbd4c-2e74-4a4a-8fad-f4bb50dd160c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.443755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 430/846] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:01 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:01.444509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cbd4c-2e74-4a4a-8fad-f4bb50dd160c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.451763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.452575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.452980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.453259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.454593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.455969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-e7dfd50e-c257-4b2a-b152-a65391c2f333 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:01.468301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:01.469300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:01.470615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 417/847] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:01.471468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.471468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.471468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.487068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:01.488247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:01.560565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-684cbd4c-2e74-4a4a-8fad-f4bb50dd160c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.574101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 418/848] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:01 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:01.574101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.600214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.601030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.601314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.601593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.608926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.610432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:01.626353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:01.627524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 431/849] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:01.633749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.638778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.646054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.692312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-773bebfb-e7af-459b-813f-e8a70e1a12c4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.728194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.733848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.733848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.733848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.733848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:01.733848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.733848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.734310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b53eff-a83f-4604-8db5-f2548866a445 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.737266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 419/850] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:01.737832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.775622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.776416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.776700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.776975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.788117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:01.795762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:01.796699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:01.797617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 432/851] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:01.798931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.855802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b980e4-660d-4a0b-8b33-8464260916a3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.869967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.871472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:01.892020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.892682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.892969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.893248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.894111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:01.894425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.895922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.907799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c58aab-7510-42a7-a6c6-b7df8953f28a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:01.914536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 420/852] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:01.915345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:01.948630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:01.949215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:01.949498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:01.949772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:01.950654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:01.950997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:01.952328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:01.964849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 433/853] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:01.964849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.036947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351186a-ad47-4766-ab98-e903863b9088 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.078858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.079778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.080166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.080542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.081517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:02.081879 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.083356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.093520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 421/854] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:02.096483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da27e10d-c338-4a06-ae12-1f4d3c3701d8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.099816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.135725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.144206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.145161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.145446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.145720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.150681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.232765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.234785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.235640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7ba59ab-1778-484b-b826-0000870a3027 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.284533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.286183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.286683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.287574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.302840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.305473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:02.330670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:02.331619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:02.332514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:02.332514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:02.332514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:02.332514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:02.335185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 422/855] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 236 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:02.340260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.358379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 434/856] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:01 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 399 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:02.366515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.400822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.465974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.477572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99ae0b6b-96ea-40db-87aa-7a1ee8639e3c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.493344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163ddd82-7977-43e2-a116-2f3a72c04352 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.516860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.517655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.517936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.518241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.528763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.530141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.535595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.536120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.536413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.536697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.537430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:02.537742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.539149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34ba5bad-b3bc-41db-a7bd-8361f846b6e1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-95216a48-82cc-4345-b9c0-e2405aeeac6c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:02.551261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:02.552094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:02.553022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:02.553022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:02.553022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:02.553022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:02.553022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 435/857] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:02.553730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2ef2-0966-41cd-a189-0c87f61ac541 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.553730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2ef2-0966-41cd-a189-0c87f61ac541 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.554014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2e2ef2-0966-41cd-a189-0c87f61ac541 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.555521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 436/858] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:02.559325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e2ef2-0966-41cd-a189-0c87f61ac541 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.562068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 423/859] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:02.562068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.562291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.562444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.580687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:02.582001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:02.652802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 424/860] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:02 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:02.653650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.666372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.683351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2e2ef2-0966-41cd-a189-0c87f61ac541 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.720567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.721238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.721522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.721799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.722541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:02.722847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.724208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.736804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 437/861] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:02.737223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.737621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.765423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7362ed4e-03c6-4bb1-80bd-f3172da31c9c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.806893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.808159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.808653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.809141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.817203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.819035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:02.836367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:02.837331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:02.838328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 425/862] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/users/swift => generated 83 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:02.838916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.847879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9e814cd-4558-456c-b0c4-1f059cac831a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.884972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.885633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.885915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.886222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:02.887062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:02.888421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:02.942088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-410f4f63-ffd3-4164-9d8c-6a4ea18b3ab8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:02.962149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 438/863] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:02 2022] POST /identity/v3/services => generated 251 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:02.962149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:02.972150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.987490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:02.993228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:02.995520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:02.995520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:02.995520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.003560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.005093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:03.025843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:03.027063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:03.028675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 426/864] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:03.030574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:03.103996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecae2a33-bd1a-4c89-b45a-342387237234 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:03.158721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:03.159665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:03.160759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:03.160759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.161396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:03.161769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.163338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.168134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a4e876-ff1c-4fcd-a9ba-3b96e6b5a690 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:03.186911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 439/865] 10.222.0.20 () {56 vars in 1135 bytes} [Wed Jul 6 16:58:02 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:03.192355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:03.215256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:03.215923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:03.216207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:03.217064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.218124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:03.218480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.220497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.234996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 427/866] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:03 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:03.240898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:03.272544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:03.309327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:03.315757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d9922d7-b580-4df0-ba51-b5b18f653666 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:03.361527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c2a0df6-c5b3-4c3b-8c68-2f6ed1cc32ca None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:03.363498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:03.365017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:03.365302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:03.365583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.397058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:03.397717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:03.398002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:03.398325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.399154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=bf1272ce812546ce8536a7fab6078c14) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:03.399470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.400956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.414349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 428/867] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:03 2022] GET /identity/v3/role_assignments?user.id=bf1272ce812546ce8536a7fab6078c14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:03.449583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.451170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.520959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:03.575765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 440/868] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:03 2022] GET /identity/v3/auth/tokens => generated 1252 bytes in 384 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:03.581620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:03.688885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674b96db-4be1-4ace-a978-6f925de4fb20 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:03.705980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:03.724751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:03.725549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:03.725833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:03.726138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.737965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.739459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:03.758082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:03.759193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:03.760077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:03.760077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:03.760077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:03.760077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:03.760077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 429/869] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:03.765245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:03.869082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3440258a-d64b-4806-8131-2b2344e1c28c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:03.903398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:03.904150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:03.904339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:03.904601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:03.905330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:03.905638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:03.907577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:03.919589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 441/870] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:03.925387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:04.032250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99105bb-301b-4305-8afa-ec3b3cef5fd7 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:04.067217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:04.068012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:04.068358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:04.068635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:04.075822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:04.077277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-71bf8b03-9683-4e76-afdb-cc05cfe7953e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:04.092570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:04.095236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:04.097399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:04.098452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 430/871] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:03 2022] GET /identity/v3/projects/service => generated 88 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:04.102050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:04.118068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d2a6-cdd5-4be1-869e-398273e3095e None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:04.118360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d2a6-cdd5-4be1-869e-398273e3095e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:04.118651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63d2a6-cdd5-4be1-869e-398273e3095e None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:04.120362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 431/872] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:04.126422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:04.126720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:04.127004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:04.129989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:04.148776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:04.150453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:04.183087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:04.232956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3642dae9-68a5-472c-bfc2-89c5ef461616 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:04.240875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 432/873] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:04 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:04.263659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:04.277087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:04.277757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:04.278144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:04.278358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:04.279360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:04.279472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:04.280870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:04.294483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 442/874] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:04.300344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:04.374473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50e1150b-aa00-4eaf-8023-a631067cb824 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:04.385522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:04.404549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb292e2f-82f8-4c7a-990b-3bcb075f3db9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:04.411095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f11a756-a8b3-461e-a98a-6da395cea655 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:04.411947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a756-a8b3-461e-a98a-6da395cea655 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:04.412389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a756-a8b3-461e-a98a-6da395cea655 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:04.412823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f11a756-a8b3-461e-a98a-6da395cea655 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:04.413710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a756-a8b3-461e-a98a-6da395cea655 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:04.415303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f11a756-a8b3-461e-a98a-6da395cea655 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:04.441022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:04.441742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:04.442052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:04.443329 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:04.443329 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=0d90c264ccd44a6e88ac202f4e6a4fde) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:04.443550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:04.445136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87a8a6f3-fba8-4ac6-9867-d247a61e0a6d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:04.458091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 443/875] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:04 2022] GET /identity/v3/role_assignments?user.id=0d90c264ccd44a6e88ac202f4e6a4fde&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:04.542975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 433/876] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:04 2022] POST /identity/v3/services => generated 269 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:05.117929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1eef5-3137-4090-8e9a-4b367b28a9c5 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.118472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1eef5-3137-4090-8e9a-4b367b28a9c5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.118581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec1eef5-3137-4090-8e9a-4b367b28a9c5 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.120117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 444/877] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:05.126080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.126381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.126662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.144892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:05.146125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:05.160505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:05.222195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 434/878] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:05.249101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1eef5-3137-4090-8e9a-4b367b28a9c5 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:05.353496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fec1eef5-3137-4090-8e9a-4b367b28a9c5 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:05.389139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:05.389855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.390178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.390455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.391658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:05.393020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:05.405155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:05.406181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:05.407072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 445/879] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:05.412558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:05.516699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8f1f97-df87-44a1-bd8d-4cbd0647e421 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:05.562173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:05.563685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.564191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.564697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.565604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:05.566134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:05.567717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc2d9543-f00b-45ac-8554-0591ae751757 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:05.573146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 435/880] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:05.578592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:05.591830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:05.596517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdb7a-a6fb-4d38-9585-df2014ac037d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.597036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdb7a-a6fb-4d38-9585-df2014ac037d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.597565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebbdb7a-a6fb-4d38-9585-df2014ac037d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.599362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 436/881] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:05.604593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.605051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.605482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.626916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:05.628319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:05.631032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:05.708764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-626f43a9-eb7e-4d93-b628-1d569dab1932 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:05.710376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 437/882] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:05 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:05.727276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:05.749668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:05.752201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.752701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.753320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.754395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:05.755170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:05.757871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:05.764644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 446/883] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:05.770307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:05.844761 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0facd75-0edc-4c99-b21a-15f9da8f4c98 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:05.866181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:05.881972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:05.883179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.883705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.884183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.891711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:05.895934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:05.898525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee585a6-6bcf-435f-b8ce-ebb6a1b0a93e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:05.906151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:05.909224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:05.910097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:05.911525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 438/884] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:05.914631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:05.941511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:05.942306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:05.942666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:05.943018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:05.944404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] RBAC: Adding query filter params (interface=public, service_id=3067f53c5caf43fa86d6669ca079a4aa, region_id=RegionOne) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:05.944797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:05.946573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:05.958089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 447/885] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/endpoints?service_id=3067f53c5caf43fa86d6669ca079a4aa&interface=public®ion_id=RegionOne => generated 194 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:05.959908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.055908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-433c8484-d822-45d9-be79-7f7ccc11392a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.080524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-878a1842-a705-4787-b810-f4ac464e8613 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.100813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.101811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.102387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.102918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.103877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:06.104389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.106294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.115825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 439/886] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:06.120902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.127281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.128521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.129005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.129499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.130489 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.132903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.150423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 448/887] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:58:05 2022] GET /identity/v3/services => generated 1268 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 16:58:06.190405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:06.237133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97722fdb-777f-470b-88f9-59485a92e186 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.275921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.276773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.277063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.277341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.289845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.291353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:06.309881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:06.310850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:06.311741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:06.311741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:06.311741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:06.311741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:06.311741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 440/888] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:06.317130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.320167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:06.426887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfa52b0c-0ea6-41e6-a38f-a79478129645 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.463016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.463684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.463964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.464246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.464973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:06.465277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.466680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c9873e-8315-4c89-8cfb-d9a7db3f8a81 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.479885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 449/889] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:06.485346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.566813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4edcc-381e-4c32-89bd-944748e9f52c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.567101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4edcc-381e-4c32-89bd-944748e9f52c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.567379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21e4edcc-381e-4c32-89bd-944748e9f52c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.569672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 450/890] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:06.575666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.576058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.576842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.596606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-163101d7-8199-4130-a39b-492029d534b3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.598660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:06.600690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:06.610449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:06.633811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.634903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.635341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.635835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.645679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.647479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:06.664689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:06.665699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:06.666665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:06.668957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:06.674333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 441/891] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:06.675369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.682644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 451/892] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:06.711688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.797737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78ef8d1a-10b9-4e74-895a-657c15a8261a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.823201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e19331dc-07b8-4ccf-a1e2-f86356989b1c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.834635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.835310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.835600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.835882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.836720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:06.837032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.838511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb8b8b0e-6ea6-436b-8249-7cfe886a21ef None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.861230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 442/893] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:06.861230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2efc7-27b9-48d5-a017-88f87baecce0 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.861230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2efc7-27b9-48d5-a017-88f87baecce0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.861230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2c2efc7-27b9-48d5-a017-88f87baecce0 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.861230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 443/894] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:06.863404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2efc7-27b9-48d5-a017-88f87baecce0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:06.865475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:06.867266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.867266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.867266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.868275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:06.869741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-d0a5efcb-5b6a-43db-aca1-9a2cb2713889 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:06.882911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:06.884109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:06.885083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 452/895] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:06.885874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:06.886019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:06.886321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:06.901746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:06.904463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:06.905765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:06.960093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:06.976739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 453/896] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:06 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:06.978098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2c2efc7-27b9-48d5-a017-88f87baecce0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:06.982904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.017413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.018209 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.018404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.018687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.090669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6780cb08-ae84-4df7-a646-ca83b9470047 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.095565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.097027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.126839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.127746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.128646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.128923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.129629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:07.129939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.130340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.131580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.136381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 454/897] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:07.137144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.190795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.213702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 444/898] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:06 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 16:58:07.214813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.244594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b6a619-8677-481e-b09c-b78846a696c8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.284223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.285032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.285314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.285592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.286268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.287634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:07.300987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:07.301953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:07.302836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 455/899] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:07.303687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.331630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca997b5c-cd47-4d9d-b599-1baab4a27ee5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.364923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.371236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.372013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.372290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.372569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.373361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:07.373564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.375667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.390075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 445/900] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:07.390075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.432877 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75288730-bedb-475f-bdbf-5b65d951b08b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.449255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.478827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.480773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.481281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.482263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.500127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.502599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.509680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1c3969c-9439-4a0f-8154-0be37abe2f36 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:07.527425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:07.528412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:07.529352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:07.529352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:07.529352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:07.529352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:07.532069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 456/901] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:07.539033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.563063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.563874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.564256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.564573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.565286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:07.565595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.567037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.572294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 446/902] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:07.577695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.644193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.673451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6033b9a0-7e0b-47a6-94b8-6ccd906d08ef None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.690379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8df3664-7fc1-4f6b-8c8a-25ce33b70112 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.716251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.717057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.717445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.717725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.718480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:07.718946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.721187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.729167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.734653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.734653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.734653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.734653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:07.734653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.734653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.738181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 457/903] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:07.741486 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.744016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 447/904] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:07.749797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.777709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.855948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ce3a0f-da67-4cf8-a8bb-72a17e78cf2f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.883601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-824bf19d-14c9-4b73-a1d8-88021ec4caa3 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:07.898843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.899626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.899910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.900185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.908393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.909948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.917369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:07.925465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:07.926445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:07.927353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:07.929341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:07.930089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 458/905] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:07.934322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:07.934833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:07.935118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:07.935930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] RBAC: Adding query filter params (interface=public, service_id=62d807a4284d43f9a8af14e58f9867f3, region_id=RegionOne) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:07.936245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:07.937654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:07.938994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:07.947502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 448/906] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/endpoints?service_id=62d807a4284d43f9a8af14e58f9867f3&interface=public®ion_id=RegionOne => generated 194 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:07.948566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:08.045562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:08.066321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-727b89d0-659a-4b19-8b7f-0486c552ba16 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:08.075926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91bf594a-be2b-440f-95a1-3a9145698e34 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:08.103370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:08.104326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.104469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.104684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.105480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:08.105789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:08.107365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:08.126071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 459/907] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:08.126255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2ba3190-2caf-4a44-b163-f829304deee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:08.126255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba3190-2caf-4a44-b163-f829304deee3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.126255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba3190-2caf-4a44-b163-f829304deee3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.126255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2ba3190-2caf-4a44-b163-f829304deee3 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.126546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba3190-2caf-4a44-b163-f829304deee3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:08.126546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2ba3190-2caf-4a44-b163-f829304deee3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:08.127963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:08.135085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 449/908] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:58:07 2022] GET /identity/v3/services => generated 1268 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 16:58:08.244901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dde43e-58b7-4963-813d-f1b1e6c2c721 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:08.283737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11d11-b46f-4b20-ad60-d15af8a6881d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.284368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11d11-b46f-4b20-ad60-d15af8a6881d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.284652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75c11d11-b46f-4b20-ad60-d15af8a6881d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.284838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:08.285452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.285736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.286199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.286299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 450/909] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:08.286944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] RBAC: Adding query filter params (role.id=247b141885a3409e817e172110131f27, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=bf1272ce812546ce8536a7fab6078c14) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:08.287255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:08.288788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:08.292175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.292711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.293207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.295387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 460/910] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:08 2022] GET /identity/v3/role_assignments?user.id=bf1272ce812546ce8536a7fab6078c14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=247b141885a3409e817e172110131f27 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:08.315713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:08.316763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:08.374220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:08.396981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 451/911] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:08 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:08.420304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:08.434669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:08.527984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8374b158-c00a-4662-bac8-8e57bea0420a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:08.565281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:08.566109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.566395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.566673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.567331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:08.568686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:08.581095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:08.582091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:08.583193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 461/912] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:08 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:08.590187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:08.695423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f15c06a9-571a-4528-9e5a-ccab0382abe4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:08.735442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:08.736567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.737045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.737534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.738460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:08.738961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:08.740542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:08.749021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 452/913] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:08 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:08.752700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:08.830123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:08.861534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5c9d08c-7d8b-439d-b39f-e815d32b9297 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:08.897494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:08.898235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:08.898563 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:08.898838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:08.899549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:08.899849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:08.901206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4a552f-071c-4ce7-b56d-1fbb89cd7dfe None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:08.907079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 462/914] 10.222.0.20 () {56 vars in 1114 bytes} [Wed Jul 6 16:58:08 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:08.912690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:08.960055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:09.017905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f578d508-0c12-4163-a622-d36d8fc54d9e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:09.052956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a5b652-8a4e-4550-a3af-5ed500c100d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:09.053963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b652-8a4e-4550-a3af-5ed500c100d7 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:09.054465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b652-8a4e-4550-a3af-5ed500c100d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:09.054960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a5b652-8a4e-4550-a3af-5ed500c100d7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:09.055924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5b652-8a4e-4550-a3af-5ed500c100d7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:09.057488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a5b652-8a4e-4550-a3af-5ed500c100d7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:09.170232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 453/915] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:58:08 2022] POST /identity/v3/endpoints => generated 346 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:09.517385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7545-ed21-47de-90a8-c903334a1613 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:09.517873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7545-ed21-47de-90a8-c903334a1613 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:09.517873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7f7545-ed21-47de-90a8-c903334a1613 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:09.519484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 463/916] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:09.524761 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a598-2939-4a98-b32e-7c12dcd0e1f1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:09.525154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a598-2939-4a98-b32e-7c12dcd0e1f1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:09.525319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b62a598-2939-4a98-b32e-7c12dcd0e1f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:09.547919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7b62a598-2939-4a98-b32e-7c12dcd0e1f1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:09.549116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7b62a598-2939-4a98-b32e-7c12dcd0e1f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:09.621671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 454/917] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:09 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:09.644392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7545-ed21-47de-90a8-c903334a1613 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:09.752071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7f7545-ed21-47de-90a8-c903334a1613 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:09.788565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c9e0b96-d831-4e6a-a1ff-2e499de3c94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:09.788565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e0b96-d831-4e6a-a1ff-2e499de3c94e None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:09.788565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e0b96-d831-4e6a-a1ff-2e499de3c94e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:09.788565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c9e0b96-d831-4e6a-a1ff-2e499de3c94e None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:09.788968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e0b96-d831-4e6a-a1ff-2e499de3c94e None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:09.789934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c9e0b96-d831-4e6a-a1ff-2e499de3c94e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:09.883824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:09.890709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 464/918] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:09 2022] POST /identity/v3/services => generated 241 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:10.276950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e623429-b68a-4ad6-9b6c-d44d09c1ef72 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.277356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e623429-b68a-4ad6-9b6c-d44d09c1ef72 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.277545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e623429-b68a-4ad6-9b6c-d44d09c1ef72 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.279163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 455/919] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:10.284823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947928-610d-4aed-807e-da3c8ff34300 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.285119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947928-610d-4aed-807e-da3c8ff34300 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.285404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9947928-610d-4aed-807e-da3c8ff34300 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.302399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b9947928-610d-4aed-807e-da3c8ff34300 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:10.303581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b9947928-610d-4aed-807e-da3c8ff34300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:10.382118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725f9c-bff8-4f33-a359-9ab6923f1faf None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.382410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725f9c-bff8-4f33-a359-9ab6923f1faf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.382680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23725f9c-bff8-4f33-a359-9ab6923f1faf None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.382907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 465/920] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:10.384234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 456/921] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:10.392245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.392531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.392808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.406251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23725f9c-bff8-4f33-a359-9ab6923f1faf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.409726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:10.410939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:10.434723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:10.479619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 466/922] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:10 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:10.502252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.518337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23725f9c-bff8-4f33-a359-9ab6923f1faf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:10.555544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:10.556366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.556651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.557188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.557859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:10.559977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:10.566361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:10.577214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:10.579898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Jul 06 16:58:10.580815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:10.584923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 457/923] 10.222.0.20 () {56 vars in 1132 bytes} [Wed Jul 6 16:58:10 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:10.585776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.623606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6608af5d-5c84-4265-a52a-fda5bde15652 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:10.668371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:10.669557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.670085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.670577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.682091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:10.691287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:10.692221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:10.693065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:10.695770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 467/924] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 6 16:58:10 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:10.701153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.704773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:10.711691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b6683cb-faa9-4ac2-8f4e-047768752b65 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:10.747942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:10.748750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.749107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.749453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.751036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:10.751417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:10.752915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:10.758447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 458/925] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:10 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:10.764605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.813814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b1007f-6a86-4f43-a657-f269087281d9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:10.829343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:10.855974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:10.857805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.858281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.858709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.860186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:10.861626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:10.863290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:10.874078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66be26bd-9678-409b-9783-73f36ad1ce8c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:10.877755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 468/926] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:58:10 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:10.878826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.910885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:10.911931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:10.912407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:10.912871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:10.913870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:10.914465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:10.916029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:10.927297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 459/927] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:10 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:10.928725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:10.948815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:10.993464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68ef5336-605a-4683-82e8-74de3b28d441 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.030907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.031724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.032005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.032279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.034242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8176ad03-17f3-405d-8917-b3da6998f9e5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.043214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.044650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:11.063912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:11.064858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:11.065748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:11.065748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:11.065748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:11.065748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:11.069915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 469/928] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:11.070899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.082200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.083165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.084102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.084561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.085911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.087483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.102694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:11.177352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d3884d-afc1-481b-bf71-9458d83b9fb7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.190059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 460/929] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:58:10 2022] POST /identity/v3/endpoints => generated 347 bytes in 258 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:11.229692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.230464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.230747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.231021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.231748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:11.232051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.233420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f71d74a-0ef4-4e24-85d1-4912151d8ebc None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.247760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 470/930] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:11.253630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.310852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd85fe-1293-4bb8-b65f-4ee299674b49 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.311163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd85fe-1293-4bb8-b65f-4ee299674b49 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.311445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd85fe-1293-4bb8-b65f-4ee299674b49 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.314213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 471/931] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:11.319212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.319869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.320379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.343697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:11.345864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:11.348385 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:11.377474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b15583-bedb-430a-ba54-fdd3cfd00f2e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.419288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.420474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.421019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.421430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.430382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.431937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.437650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 472/932] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:11 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:11.455625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:11.456650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.457624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 461/933] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:11.459506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.461827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.478642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:11.570931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e465b844-424c-41ff-b990-83d8aa7b9dfd None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.592098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e3ad651-e996-4df4-8af0-ce26d406a1a0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.607504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.608180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.608464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.608738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.609623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:11.609936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.611406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.629550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 473/934] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:11.632978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.633828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.634290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.634717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.635045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.635892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.637461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.639224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING keystone.server.flask.common [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Jul 06 16:58:11.643223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:11.699680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.sql.core [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 16:58:11.699680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 16:58:11.699680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [parameters: {'id': '3f33b1521d8a4b5f91cadd00b85ef2db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 16:58:11.699680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 16:58:11.708341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f33b1521d8a4b5f91cadd00b85ef2db.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f33b1521d8a4b5f91cadd00b85ef2db. Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application conn.query(q) Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 16:58:11.719705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result.read() Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Jul 06 16:58:11.722435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return project_ref.to_dict() Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application next(self.gen) Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application yield resource Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application next(self.gen) Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise self.value Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application session.commit() Jul 06 16:58:11.723417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.session.flush() Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application compat.raise_( Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 16:58:11.724300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application c = connection._execute_20( Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 16:58:11.725178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application conn.query(q) Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result.read() Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 16:58:11.726106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [parameters: {'id': '3f33b1521d8a4b5f91cadd00b85ef2db', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.726971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:11.728024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.Conflict( Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 3f33b1521d8a4b5f91cadd00b85ef2db. Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.729128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 462/935] 10.222.0.20 () {60 vars in 1140 bytes} [Wed Jul 6 16:58:11 2022] POST /identity/v3/projects => generated 262 bytes in 260 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:11.731287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.749307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994a923b-bc95-4bda-a0fa-5a45cd86aa55 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.812311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.815056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.815719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.816700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.837764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.841387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:11.879450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:11.881127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:11.882237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:11.882237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:11.882237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:11.882237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:11.888573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 474/936] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:11.889260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:11.903207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f87d432-abec-4716-8ea1-5df73dfc31df None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:11.945426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:11.946397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:11.946685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:11.946962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:11.954957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:11.956587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:11.971431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:11.972379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:11.973271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:11.977555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 463/937] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:11.978819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.024726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67e1d64-debe-4c08-8eba-39fbcb6eea39 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.032053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:12.049334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:12.061547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.062534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.063348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.063627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.064952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:12.065277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.067133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b50479-9c21-4af6-8ac0-1b5f10bc94b8 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.080627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 475/938] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:12.082230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646320c-2e3e-4f4c-a5d1-c42e073fd5d0 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.082424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646320c-2e3e-4f4c-a5d1-c42e073fd5d0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.082654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2646320c-2e3e-4f4c-a5d1-c42e073fd5d0 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.083999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 476/939] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:12.086848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646320c-2e3e-4f4c-a5d1-c42e073fd5d0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.090171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843bfaf6-7951-4d44-a8ae-fec25cbc9fe5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.125037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.126267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.126553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.126836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.127597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:12.127908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.129339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea482322-5a20-48b0-8de0-f26842cdd92d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.150099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 464/940] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:11 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:12.154268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.154268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.154268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.172854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:12.174471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:12.222136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2646320c-2e3e-4f4c-a5d1-c42e073fd5d0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.262053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.263441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.263879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.264264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.264796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 465/941] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:12 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:12.280448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.282238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.287544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:12.304567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:12.305515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:12.307043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 477/942] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:12.314188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.341779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:12.378819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:12.414842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c36595a4-1d3e-4e6f-ac2d-be3a2f9dc6c3 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.448348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cde3d23b-da74-4278-8e54-3794e3a1b1c8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.456616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.457434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.457716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.458474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.459301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.461386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:12.478322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:12.479355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:12.480185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:12.480929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 466/943] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:12.486716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.492193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.492871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.493160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.493442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.494274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:12.494585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.496567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.511056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 478/944] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:12.516652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.600468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b702399-fccb-4e09-be17-1735e1afa797 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.602854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:12.631136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fdf301-14f4-455d-988f-1e7129209b56 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.634557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:12.637071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.638014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.638760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.639256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.640278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:12.640844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.642702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.652844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 467/945] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:12.654233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.671782 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.673551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.674052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.674597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/bf1272ce812546ce8536a7fab6078c14/roles/247b141885a3409e817e172110131f27` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.677130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=bf1272ce812546ce8536a7fab6078c14, role_id=247b141885a3409e817e172110131f27)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.678789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.746730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 479/946] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:58:12 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/bf1272ce812546ce8536a7fab6078c14/roles/247b141885a3409e817e172110131f27 => generated 0 bytes in 230 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:58:12.761507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a3f3642-c78e-4152-92e6-b101911335dc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.802996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.803793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.804082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.804362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.805142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:12.805457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.806973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.818207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 468/947] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:12.820033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:12.938543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa1e027-9188-48e7-b3ae-25e98c7bdc9b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:12.975374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:12.976379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:12.976867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:12.977320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:12.978334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] RBAC: Adding query filter params (interface=public, service_id=38e1205c6ccb4f359b8bfa8bc571c953, region_id=RegionOne) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:12.978826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:12.980388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bace034d-a911-40df-80ed-e9add51a306d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:12.990126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 480/948] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/endpoints?service_id=38e1205c6ccb4f359b8bfa8bc571c953&interface=public®ion_id=RegionOne => generated 194 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:12.992312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:13.025298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:13.097177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849e9bab-97a9-4915-898b-b731d3885c5f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:13.132337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86094c0c-9d07-4d2f-80c7-739700ee243d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:13.133061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094c0c-9d07-4d2f-80c7-739700ee243d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:13.133354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094c0c-9d07-4d2f-80c7-739700ee243d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:13.133689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86094c0c-9d07-4d2f-80c7-739700ee243d None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:13.134598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094c0c-9d07-4d2f-80c7-739700ee243d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:13.135976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86094c0c-9d07-4d2f-80c7-739700ee243d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:13.150227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 469/949] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:58:12 2022] GET /identity/v3/services => generated 1497 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 16:58:13.367384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387df02e-015a-4612-922f-7bdc7c94a8d2 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:13.367795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387df02e-015a-4612-922f-7bdc7c94a8d2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:13.367987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-387df02e-015a-4612-922f-7bdc7c94a8d2 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:13.369561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 481/950] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:13.374618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:13.374917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:13.375750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:13.396435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:13.397684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:13.468429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 470/951] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:13 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:13.490502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387df02e-015a-4612-922f-7bdc7c94a8d2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:13.525229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:13.600455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-387df02e-015a-4612-922f-7bdc7c94a8d2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:13.635765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:13.636487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:13.636761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:13.637042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:13.637695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:13.639152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:13.651496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:13.652592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:13.653503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 482/952] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:13 2022] GET /identity/v3/services/compute => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:13.660813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:13.689383 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:13.763820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb042d64-2717-4a33-a78a-ae382ae0cfba None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:13.801565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:13.802255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:13.802539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:13.802816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:13.803591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] RBAC: Adding query filter params (name=compute) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:13.803903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:13.805281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb9cf5c0-687d-40b5-ab7b-f89148738dcb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:13.810763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 471/953] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:13 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:13.816978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:13.910654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:13.919385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a8c414b-43b7-49fd-b2d9-ec22d06449f9 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:13.956885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:13.957553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:13.957837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:13.958140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:13.958853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] RBAC: Adding query filter params (type=compute) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:13.959155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:13.960517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab5eba7-7597-4430-a555-af2a6b44cf1f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:13.965575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 483/954] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:13 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:14.459864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d4439-7da3-4c57-8ca2-f833c5febd1b None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:14.460191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d4439-7da3-4c57-8ca2-f833c5febd1b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:14.460435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d1d4439-7da3-4c57-8ca2-f833c5febd1b None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:14.462206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 472/955] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:14.467455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:14.467750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:14.468032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:14.485610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:14.486829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:14.562183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 484/956] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:14.581636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d4439-7da3-4c57-8ca2-f833c5febd1b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:14.674294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:14.685752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d1d4439-7da3-4c57-8ca2-f833c5febd1b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:14.721744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:14.722778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:14.723287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:14.723760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:14.724660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:14.726311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:14.776845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.sql.core [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 16:58:14.776845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 16:58:14.776845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [parameters: {'user_id': 'a2c0bad553d04645a81d9d781dce2624', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 16:58:14.776845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80631) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ea53aa52-90f6-4322-966a-c00a39ee12c0 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application conn.query(q) Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result.read() Jul 06 16:58:14.785673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return method(*args, **kwargs) Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 16:58:14.786555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application next(self.gen) Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application yield resource Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application next(self.gen) Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.session.rollback() Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.force_reraise() Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise self.value Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application session.commit() Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Jul 06 16:58:14.787685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._prepare_impl() Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.session.flush() Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._flush(objects) Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application compat.raise_( Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application flush_context.execute() Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rec.execute(self) Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Jul 06 16:58:14.788593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application _emit_insert_statements( Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result = connection._execute_20( Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 332, in _execute_on_connection Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ret = self._execute_context( Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Jul 06 16:58:14.798156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self.dialect.do_execute( Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result = self._query(query) Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application conn.query(q) Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application result.read() Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Jul 06 16:58:14.799029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application packet.raise_for_error() Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [parameters: {'user_id': 'a2c0bad553d04645a81d9d781dce2624', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:14.800558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Jul 06 16:58:14.802511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:14.807864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 473/957] 10.222.0.20 () {60 vars in 1131 bytes} [Wed Jul 6 16:58:14 2022] POST /identity/v3/users => generated 160 bytes in 210 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:14.808762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:14.861025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8217-7b53-4868-827e-04208c9cc8d3 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:14.861307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8217-7b53-4868-827e-04208c9cc8d3 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:14.861597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bec8217-7b53-4868-827e-04208c9cc8d3 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:14.867541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 474/958] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:14 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:14.872873 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:14.873440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:14.873931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:14.891004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:14.894673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:14.896436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:14.905936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8498f4-1e88-4757-a473-44a3cd755b3d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:14.953962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:14.955584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:14.956081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:14.956562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:14.966772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:14.969763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:14.990143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 475/959] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:14 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:14.991998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:14.992906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Jul 06 16:58:14.993837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:14.997917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 485/960] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:14.999182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.013344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.092088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:15.113207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7223b3c1-7e61-40cb-9b2f-81206767bd1b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.124680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86916bd9-7316-4af5-912d-9f364477f097 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.149948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.151010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.151498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.152018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.152993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:15.157723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.157723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d574b8c5-2297-4f49-ad97-2ef9754bc04f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.162019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.162855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.163139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.163479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.175319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:15.184005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:15.184952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:15.185785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:15.190313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 486/961] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:15.191487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.198612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 476/962] 10.222.0.20 () {56 vars in 1101 bytes} [Wed Jul 6 16:58:14 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:15.243581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:15.300680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dabf84-38e9-4f5f-a320-676c22d054cb None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.300970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dabf84-38e9-4f5f-a320-676c22d054cb None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.301261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40dabf84-38e9-4f5f-a320-676c22d054cb None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.303214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 477/963] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:15.308540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f652f5a-6f89-4635-b662-43157c91a577 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.309016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.309309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.309589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.331987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:15.334843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:15.353408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.354875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.355711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.356185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.357309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:15.358120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.359768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.372230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 487/964] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:15.377571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.426656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 478/965] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:15 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:15.451336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.462906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:15.504443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29714cb7-40a8-4a95-bbbd-70eef935eb66 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.549297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.549645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:15.550360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.550732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.551011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.562357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.571872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:15.582400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:15.583450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:15.584540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:15.584540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:15.584540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:15.584540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:15.584819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4aa087f4-6850-4ef0-8790-9623dd0676fd None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.586208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 488/966] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:15.591574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.626188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.627041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.627272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.627549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.628914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.629599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:15.642893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:15.643913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:15.644763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 479/967] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:15.649814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.699747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f3899fc-649a-44a6-8fc2-b02291ebf417 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.720996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:15.735070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.735741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.736027 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.736307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.737036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:15.737349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.738760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.761237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 489/968] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:15.761398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd470d0-2176-4d10-a652-549163411ac4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.761829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.791956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.793090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.793090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.793304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.793894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:15.794237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.795613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.796970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:15.805711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 480/969] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:15.806795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.869459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a69cd2-2bba-4b11-acf5-583b2c5df08a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.906994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.907808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.908092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.908382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.915700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.916221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b6c852-3c05-4c0f-bfa6-0b2da62724f6 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:15.917132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:15.933386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:15.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:15.935619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 490/970] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:15.940698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.957409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:15.958105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:15.958390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:15.958666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:15.959365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:15.959669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:15.961030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:15.966610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 481/971] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:15.972201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:15.987576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.036705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.050889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e167aae5-b408-4075-9223-7d379cc47e1a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.075868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165f03b9-ca56-4855-8a1c-9eaf637d6eed None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.084825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.085494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.085785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.086105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.086941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:16.087249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.088672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44c5c1ef-a11e-467d-8444-cd1e30d17d39 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.106224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 491/972] 10.222.0.20 () {56 vars in 1149 bytes} [Wed Jul 6 16:58:15 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:16.107291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e30e-18a5-43b9-80e4-2b5a3cd2677b None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.107580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e30e-18a5-43b9-80e4-2b5a3cd2677b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.107871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3257e30e-18a5-43b9-80e4-2b5a3cd2677b None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.109086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 492/973] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:16 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:16.111918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e30e-18a5-43b9-80e4-2b5a3cd2677b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:16.112467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-446a1fab-369c-4f2b-8d47-a177c0e16d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.113125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a1fab-369c-4f2b-8d47-a177c0e16d74 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.113403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a1fab-369c-4f2b-8d47-a177c0e16d74 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.113675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-446a1fab-369c-4f2b-8d47-a177c0e16d74 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.114463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a1fab-369c-4f2b-8d47-a177c0e16d74 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.115813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-446a1fab-369c-4f2b-8d47-a177c0e16d74 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.191159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 482/974] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:58:15 2022] POST /identity/v3/endpoints => generated 349 bytes in 219 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:16.192914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.193417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.193897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.207598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.211506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:16.212716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:16.220037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3257e30e-18a5-43b9-80e4-2b5a3cd2677b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.260486 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.261146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.261577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.261855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.288088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 483/975] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:16 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:16.312257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:16.339452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.340902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.372767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.426013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43b539cd-994f-44ce-9e4d-ab1a848efd17 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.440497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.448682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 493/976] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:16 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 16:58:16.455063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:16.467959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.468633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.468952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.469238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.469963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.471365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.538376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 484/977] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:16 2022] POST /identity/v3/services => generated 242 bytes in 227 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:16.571161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf206244-c21d-4d74-829e-38e2ad5ef9d7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.616937 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.617802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.618155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.618436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.631546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.633204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:16.652767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:16.653744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:16.659606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:16.659606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:16.659606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:16.659606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:16.659606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 494/978] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:16.661539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:16.770116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd751e7-573b-427d-983c-f09075badd0a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.780119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.804524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.805132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.805416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.805694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.806446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:16.806755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.808154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.821207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 485/979] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:16.826940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:16.870704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:16.929702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f0c4baa-9238-4f52-a25f-c2004d75b10e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:16.964897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:16.965693 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:16.965977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:16.966288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:16.973077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:16.974561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:16.990041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:16.991000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:16.991893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:16.994100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 495/980] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:16.996948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:17.102607 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-963d1d2f-d8e7-4665-b0fb-800b7d237a74 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:17.136839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:17.137500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:17.137787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:17.138092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:17.138886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:17.139200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:17.140654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8971a23b-12f3-4209-a8e3-799301314cff None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:17.152977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 486/981] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:17.159323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:17.256479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349a7920-b4a4-4f61-8c99-76337bf4ddc7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:17.258340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:17.309857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:17.309857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:17.309857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:17.309857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:17.310738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] RBAC: Adding query filter params (role.id=247b141885a3409e817e172110131f27, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=bf1272ce812546ce8536a7fab6078c14) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:17.310738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:17.310738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29b1943d-56ac-48ac-8dbd-b986d3cdf424 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:17.310738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 496/982] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:17 2022] GET /identity/v3/role_assignments?user.id=bf1272ce812546ce8536a7fab6078c14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=247b141885a3409e817e172110131f27 => generated 608 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:18.245238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27927a93-d6a6-48c1-8e0a-7b74d7a8b4ab None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.245804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27927a93-d6a6-48c1-8e0a-7b74d7a8b4ab None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.245804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27927a93-d6a6-48c1-8e0a-7b74d7a8b4ab None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.247390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 487/983] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:18.252387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.252803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.252972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.270532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:18.271710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:18.338058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 497/984] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:18.361016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27927a93-d6a6-48c1-8e0a-7b74d7a8b4ab None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:18.389797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:18.466545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27927a93-d6a6-48c1-8e0a-7b74d7a8b4ab None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:18.500793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:18.501514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.501795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.502096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.502744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:18.504102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-578d1c1b-a6eb-4e2a-8ecc-f677e5cc385e None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:18.516589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:18.517555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:18.518914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 488/985] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:18 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:18.525621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:18.587231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f92831-56f8-469b-8204-926c3fd0a292 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.587512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f92831-56f8-469b-8204-926c3fd0a292 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.587795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f92831-56f8-469b-8204-926c3fd0a292 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.589272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 489/986] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:18.593751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.594077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.594350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.610472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:18.611638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:18.627056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:18.634413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9e54d6-c3c4-4133-ae6a-57b3e0d0fde4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:18.673109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:18.674262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.674862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.675290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.676677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:18.677148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:18.678988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:18.679777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 490/987] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:18 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:18.684454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 498/988] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:18 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:18.690577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:18.702516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:18.716584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:18.800705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad535a2-67a2-4efd-abda-8ee065594f94 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:18.817696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edd801d-3541-4323-95d6-7749c8e062eb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:18.839122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:18.839997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.840457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.840885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.841735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:18.842214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:18.843737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:18.849969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 491/989] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:18 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:18.851688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:18.852482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:18.852760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:18.853030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:18.853675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:18.855059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:18.856106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:18.866962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:18.868026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:18.868905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 499/990] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:18 2022] GET /identity/v3/services/compute => generated 88 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:18.874267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:18.902928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:18.954677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:18.970790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c03228a1-1c38-45c0-b6ab-d8a4cdfec21a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:18.982668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dff440-6e1f-4bdf-860f-4a6fea914ff6 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.007510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.008169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.008451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.008742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.009520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] RBAC: Adding query filter params (interface=admin, service_id=38e1205c6ccb4f359b8bfa8bc571c953, region_id=RegionOne) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:19.009830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.011242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.016652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 492/991] 10.222.0.20 () {56 vars in 1249 bytes} [Wed Jul 6 16:58:18 2022] GET /identity/v3/endpoints?service_id=38e1205c6ccb4f359b8bfa8bc571c953&interface=admin®ion_id=RegionOne => generated 193 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:19.021131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.021694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.021974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.022113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.022283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.022978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:19.023281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.024638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.034745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 500/992] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:18 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:19.035613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.129696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64b0c2f7-8164-492a-ac0d-2bd84c2c6184 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.131780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:19.143827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ae24eb6-d5e5-4e4a-92e0-5a8273745b86 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.166963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.167627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.167903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.168177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.168850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.170244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.177124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 493/993] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/services => generated 1727 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 16:58:19.181479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.182197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.182484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.182763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.183498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:19.183808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.185225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234bb463-22b0-400c-9022-f42a6450ffd4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.192034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 501/994] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:19.197881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.215170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:19.307681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddebf8ef-7694-45be-83bd-aae96fce25c8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.346336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.347004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.347289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.347565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.348394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] RBAC: Adding query filter params (interface=public, service_id=7b6b92ac78b74cfdacce11e6e8595591, region_id=RegionOne) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:19.348707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.350434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.355901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 494/995] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/endpoints?service_id=7b6b92ac78b74cfdacce11e6e8595591&interface=public®ion_id=RegionOne => generated 194 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:19.356848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74375f-df22-4a14-8592-b7c73b7556e1 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.357287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74375f-df22-4a14-8592-b7c73b7556e1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.357481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b74375f-df22-4a14-8592-b7c73b7556e1 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.358964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 502/996] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:19.361557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.364571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.364860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.365139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.381873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:19.383035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:19.444964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:19.449787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 503/997] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:19 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:19.467315 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9e010c-93e1-47b9-9757-cae198dab8ab None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.471872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.505778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.506482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.506767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.507045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.507726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.509092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.515624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 495/998] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 16:58:19.567719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:19.587013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a19dada-b2c2-4457-8959-e194a17ef587 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.625133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.625938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.626253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.626532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] PATH_INFO: `/v3/services/image` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.627218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.628609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:19.642421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:19.643786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:19.644923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 504/999] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:19.648879 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.752093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e027ab-043b-4487-8de4-b6c691ba5c4c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.787072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.787737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.788020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.788298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.789008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] RBAC: Adding query filter params (name=image) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:19.789315 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.790797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76231660-e748-4f79-9cde-df8bbd8f5be7 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.795792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 496/1000] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/services?name=image => generated 122 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:19.801470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:19.903189 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e2d1cd2-d04b-422a-8881-00229a343324 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:19.936200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:19.936907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:19.937188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:19.937488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:19.938267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] RBAC: Adding query filter params (type=image) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:19.938571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:19.939928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71553790-55cf-49ab-a171-d81420295d14 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:19.944519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 505/1001] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:19 2022] GET /identity/v3/services?type=image => generated 122 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:21.189837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd598c-b1c9-47cb-80ac-5171635ca92c None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.190380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd598c-b1c9-47cb-80ac-5171635ca92c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.190486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52dd598c-b1c9-47cb-80ac-5171635ca92c None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.191910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 497/1002] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:21.196792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.197162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.197348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.214156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:21.215331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:21.219504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:21.282923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 506/1003] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:21.305072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd598c-b1c9-47cb-80ac-5171635ca92c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:21.314513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:21.409026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52dd598c-b1c9-47cb-80ac-5171635ca92c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:21.442370 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:21.443104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.443390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.443668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.444318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:21.445687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-07987e8a-86db-4d86-85c7-84a6bd0fa8ae None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:21.458372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:21.459471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:21.460319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 498/1004] 10.222.0.20 () {56 vars in 1126 bytes} [Wed Jul 6 16:58:21 2022] GET /identity/v3/services/object-store => generated 93 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:21.467528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:21.542148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e86a-a759-4d9b-b2e6-59d78fffe001 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.542442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e86a-a759-4d9b-b2e6-59d78fffe001 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.542724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba38e86a-a759-4d9b-b2e6-59d78fffe001 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.544093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 499/1005] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:21.550409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.550781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.551128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.568549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:21.570189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:21.576144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7552c69-0228-4da0-8579-ba51fb41ccc0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:21.611948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:21.612614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.612901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.613182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.613887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:21.614239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:21.615606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:21.625722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 507/1006] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:21 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:21.626729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:21.631976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:21.638350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:21.644716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 500/1007] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:21 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:21.667112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:21.735830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab05f411-746c-4f79-a05f-28f14d505ccc None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:21.771126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:21.771789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.772068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.772343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.773049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:21.773353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:21.774646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-835b30b5-d2d7-41d1-9cbc-1e16fc235760 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:21.774769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:21.789234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 508/1008] 10.222.0.20 () {56 vars in 1122 bytes} [Wed Jul 6 16:58:21 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:21.790513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:21.810297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:21.811446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.812320 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.813332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.814474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:21.816779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:21.832035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:21.833059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:21.833900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 501/1009] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:21 2022] GET /identity/v3/services/compute => generated 88 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:21.839120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:21.863812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:21.900668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c8e2951-c28d-4359-86be-a34fb6d3d05f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:21.906169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:21.939013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4abf7bc5-df8e-4046-acf8-14ee8f2e3f66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:21.939672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7bc5-df8e-4046-acf8-14ee8f2e3f66 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.939954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7bc5-df8e-4046-acf8-14ee8f2e3f66 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.940232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4abf7bc5-df8e-4046-acf8-14ee8f2e3f66 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.940969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7bc5-df8e-4046-acf8-14ee8f2e3f66 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:21.942354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4abf7bc5-df8e-4046-acf8-14ee8f2e3f66 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:21.946880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f148fc0-ca3a-4bfa-9e11-4feb672923e0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:21.979974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:21.980629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.980910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.981182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.981878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:21.982221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:21.983627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77d9143-c5c9-4c24-9eef-9c22aecdf8f5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:21.993364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 502/1010] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:21 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:21.993364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751e1e-d61c-4d0d-8ea0-baf7b354c4de None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:21.993364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751e1e-d61c-4d0d-8ea0-baf7b354c4de None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:21.993364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92751e1e-d61c-4d0d-8ea0-baf7b354c4de None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:21.993364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 503/1011] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:21 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:21.994357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751e1e-d61c-4d0d-8ea0-baf7b354c4de None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:22.026057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 509/1012] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:58:21 2022] POST /identity/v3/endpoints => generated 325 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:22.026057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:22.026057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:22.026057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:22.035516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:22.036751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:22.117386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 510/1013] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:22 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:22.119486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92751e1e-d61c-4d0d-8ea0-baf7b354c4de None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:22.141268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:22.147563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:22.160350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:22.161025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:22.161309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:22.161589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:22.162349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] RBAC: Adding query filter params (type=compute) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:22.162657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:22.164024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:22.169723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 504/1014] 10.222.0.20 () {56 vars in 1112 bytes} [Wed Jul 6 16:58:21 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:22.176063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:22.206586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:22.253872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3871568-d9b3-4a63-9f9e-67afb8cdb81b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:22.288474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14705338-9760-4bb9-9df0-d7b9ed6af4cf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:22.289024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68110fc-e148-4299-89cc-5b5a2fe4517f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:22.289639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68110fc-e148-4299-89cc-5b5a2fe4517f None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:22.289919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68110fc-e148-4299-89cc-5b5a2fe4517f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:22.290228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68110fc-e148-4299-89cc-5b5a2fe4517f None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:22.290946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68110fc-e148-4299-89cc-5b5a2fe4517f None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:22.292304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68110fc-e148-4299-89cc-5b5a2fe4517f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:22.324717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75cc0122-c82c-40df-85de-70669aaa2c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:22.325376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0122-c82c-40df-85de-70669aaa2c76 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:22.325660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0122-c82c-40df-85de-70669aaa2c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:22.325939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75cc0122-c82c-40df-85de-70669aaa2c76 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:22.326712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc0122-c82c-40df-85de-70669aaa2c76 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:22.328106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75cc0122-c82c-40df-85de-70669aaa2c76 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:22.388628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 511/1015] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:22 2022] POST /identity/v3/services => generated 242 bytes in 248 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:22.417691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 505/1016] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:58:22 2022] POST /identity/v3/endpoints => generated 334 bytes in 242 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:58:24.068210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239900-ae43-4e7e-a7a1-c18171d30ce6 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.068748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239900-ae43-4e7e-a7a1-c18171d30ce6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.068748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d239900-ae43-4e7e-a7a1-c18171d30ce6 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.070197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 512/1017] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:24.075248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.075630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.075814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.092574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:24.094464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:24.146210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:24.175954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 506/1018] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:24.198947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239900-ae43-4e7e-a7a1-c18171d30ce6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.303487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d239900-ae43-4e7e-a7a1-c18171d30ce6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:24.317852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:24.338430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7828cd-aef5-4a93-bb58-fde371b4f1ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:24.339149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7828cd-aef5-4a93-bb58-fde371b4f1ed None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.339430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7828cd-aef5-4a93-bb58-fde371b4f1ed None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.339703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7828cd-aef5-4a93-bb58-fde371b4f1ed None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.340998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7828cd-aef5-4a93-bb58-fde371b4f1ed None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:24.342459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7828cd-aef5-4a93-bb58-fde371b4f1ed None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:24.344802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 513/1019] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:24 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:24.350645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.432781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1cdd-37d6-45b8-be59-85f5121d5bfc None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.433077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1cdd-37d6-45b8-be59-85f5121d5bfc None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.433358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddd1cdd-37d6-45b8-be59-85f5121d5bfc None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.435020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 514/1020] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:24.439567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.439857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.440135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.456420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ff4646-0335-4237-b03f-be8e15e16012 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:24.456924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:24.458133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:24.492075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6c95bd-ea02-4641-a1c0-fa90c3334298 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:24.492742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c95bd-ea02-4641-a1c0-fa90c3334298 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.493027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c95bd-ea02-4641-a1c0-fa90c3334298 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.493304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6c95bd-ea02-4641-a1c0-fa90c3334298 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.494047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c95bd-ea02-4641-a1c0-fa90c3334298 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:24.495504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6c95bd-ea02-4641-a1c0-fa90c3334298 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:24.528211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 515/1021] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:24.551321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.584316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 507/1022] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:24 2022] POST /identity/v3/projects => generated 311 bytes in 234 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:24.586050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2259-01bc-4c87-8310-641f879766ec None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.586364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2259-01bc-4c87-8310-641f879766ec None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.586649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d2259-01bc-4c87-8310-641f879766ec None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.588038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 508/1023] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:24.599189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.599189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.599189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.613426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:24.614913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:24.636115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:24.662157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea3c2fb8-ba26-4000-bff6-10a7a8ba0d56 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:24.677677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:24.695331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 509/1024] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:24 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:24.704763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:24.705807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.706806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.707225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] PATH_INFO: `/v3/services/image` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.708017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:24.709534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:24.720185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:24.723066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:24.724036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:24.724886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 516/1025] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 6 16:58:24 2022] GET /identity/v3/services/image => generated 86 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:24.729793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.896397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fca6d36b-a281-4885-a6f4-4a34f42d7514 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:24.930675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64cbf0dc-4214-410c-b392-d30f9b5edcf2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:24.938432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:24.939391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.939670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.939942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.955984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:24.963844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:24.964863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:24.965713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 510/1026] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 6 16:58:24 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:24.970086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:24.970755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:24.970871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.971032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:24.971308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:24.972011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] RBAC: Adding query filter params (name=image) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:24.972314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:24.973736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:24.979941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 517/1027] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:24 2022] GET /identity/v3/services?name=image => generated 122 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:24.987593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:24.996028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.033014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.087223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6f38db-e064-4f11-b3b2-631eb8709bd9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.092050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7440a6e9-04f8-46d4-b605-37ecf18a487d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.128295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.129095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.129381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.129727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.130698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:25.131011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.132155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.132450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.132819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.133103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.133379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.134111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] RBAC: Adding query filter params (type=image) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:25.134425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.135801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.140931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 518/1028] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:24 2022] GET /identity/v3/services?type=image => generated 350 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:25.141677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 511/1029] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:58:24 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:25.146604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.146967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.226356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.252889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b207e8-c9d3-409a-b930-bab19c30d630 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.253592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11fe13d8-4e37-4fdc-ab2c-7cba140a9c9d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.256382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.289542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.290235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.290520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.290800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.291586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] RBAC: Adding query filter params (interface=public, service_id=63f7134aa2404403824335d7e1dd72ac, region_id=RegionOne) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:25.291898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.293259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.293676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.294495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.294790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.295071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.299508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 519/1030] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/endpoints?service_id=63f7134aa2404403824335d7e1dd72ac&interface=public®ion_id=RegionOne => generated 194 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:25.304703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.306861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.308589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:25.327649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:25.328848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:25.334521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:25.334521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:25.334521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:25.334521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:25.334521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 512/1031] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:25.334521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.419279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c621394-ee81-43df-90f2-24ae4442053a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.436946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b913cbce-c488-43e5-9447-455c595f03a4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.455129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.455799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.456209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.458134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.458134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.458555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.461894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.466467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 520/1032] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/services => generated 1957 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 16:58:25.474846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.475537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.475824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.476101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.476849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:25.477254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.478694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.493507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 513/1033] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:25.498887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.537531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.610457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df2cc8c6-1fcf-4f1c-b6ef-99f9665ad34d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.649309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.650144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.650441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.650709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.659226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.660673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:25.675578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:25.676628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:25.677606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 521/1034] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:25.682640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.787490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6252537c-4181-4509-8aa4-5e1764001c29 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.821216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.821887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.822205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.822488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:25.823327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:25.823637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:25.825056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:25.847888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 514/1035] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:25.849130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:25.942477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:25.949828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f7578f7-8043-45f4-8e7f-5e577b9237b1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:25.984469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:25.985355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:25.985805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:25.986258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.053792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.055534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:26.144829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:26.159708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 522/1036] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:25 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:26.165247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.212423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:26.267932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb355971-0be3-4faf-a376-c9c84f4f7990 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:26.301125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:26.301917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.302228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.302507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.313232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.314877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:26.332770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:26.333673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:26.334625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:26.334625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:26.334625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:26.334625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:26.334625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 515/1037] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:26.340619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.439864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba1445e-1a52-4f89-89db-f868550a62d1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:26.473127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:26.473716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.474000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.474321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.475042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:26.475351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.476830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-222a9684-e81a-4b36-82d5-8d08e3d9bcbf None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:26.492863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 523/1038] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:26.494338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.599668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:26.606001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7cedce-5c3c-4fa7-80e7-068c16e6160f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:26.641064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:26.641861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.642179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.642459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.649162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.650763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:26.651241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aba82-2a64-4054-9c83-18cb4c7ebe32 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.651537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aba82-2a64-4054-9c83-18cb4c7ebe32 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.651822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-445aba82-2a64-4054-9c83-18cb4c7ebe32 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.653208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 524/1039] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:26.658454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.658745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.659019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:26.666702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:26.667597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:26.668511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:26.673011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 516/1040] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:26.674023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.678468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:26.679642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:26.729815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:26.750775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 525/1041] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:26 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:26.775614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.784506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782f4ac9-c7e7-4b3b-86e2-9bfb49ba79ff None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:26.822992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:26.824200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.824679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.825037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.825826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:26.826165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.827588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:26.839410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 517/1042] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:26 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:26.845854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.865548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:26.880906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb31653f-d90d-49b6-8d97-90d16eac239c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:26.916339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:26.917128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.917408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.917681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.918888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.920314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:26.922711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 526/1043] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:26.928262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:26.954432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfe14b94-7de3-4466-9ceb-e2e237c54e1b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:26.980496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:26.993039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:26.993734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:26.994015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:26.994567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:26.995147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] RBAC: Adding query filter params (role.id=247b141885a3409e817e172110131f27, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=45e533c543494ad2a9a294458fa79d14) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:26.995454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:26.996886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a843485-c1ca-4b96-b87f-0f3a5f0e0a44 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:27.002598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 518/1044] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:26 2022] GET /identity/v3/role_assignments?user.id=45e533c543494ad2a9a294458fa79d14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=247b141885a3409e817e172110131f27 => generated 259 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:27.039594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24de3c3-2885-4a1b-adf1-e3e0a3ef5c27 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:27.078942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a0384a6-5f3f-491c-8e37-2c9663c6a58d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:27.079628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0384a6-5f3f-491c-8e37-2c9663c6a58d None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:27.079911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0384a6-5f3f-491c-8e37-2c9663c6a58d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:27.080188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a0384a6-5f3f-491c-8e37-2c9663c6a58d None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:27.080914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0384a6-5f3f-491c-8e37-2c9663c6a58d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:27.082400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a0384a6-5f3f-491c-8e37-2c9663c6a58d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:27.183034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 527/1045] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:58:26 2022] POST /identity/v3/users => generated 285 bytes in 255 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:27.536107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43ee4-b7bd-4314-8871-5cc69f303833 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:27.536650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43ee4-b7bd-4314-8871-5cc69f303833 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:27.536650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b43ee4-b7bd-4314-8871-5cc69f303833 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:27.538056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 519/1046] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:27.543335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:27.543631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:27.543910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:27.564220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:27.565408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:27.633933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 528/1047] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:27 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:27.657285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b43ee4-b7bd-4314-8871-5cc69f303833 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:27.741466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:27.762420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b43ee4-b7bd-4314-8871-5cc69f303833 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:27.796156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:27.797179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:27.797611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:27.798054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] PATH_INFO: `/v3/services/image` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:27.798798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:27.800170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:27.812940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:27.813920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:27.814809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 520/1048] 10.222.0.20 () {56 vars in 1105 bytes} [Wed Jul 6 16:58:27 2022] GET /identity/v3/services/image => generated 86 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:27.823925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:27.857816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:27.922800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cf8c3e1-04fa-4f5d-828c-70ed8649a144 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:27.957391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:27.958070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:27.958403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:27.958683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:27.959387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] RBAC: Adding query filter params (name=image) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:27.959688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:27.961047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:27.966251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 529/1049] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:27 2022] GET /identity/v3/services?name=image => generated 122 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:27.971823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:28.074467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1922dbf4-a907-4247-b326-30d0110825cc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:28.111095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:28.111763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:28.112045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:28.112322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:28.113027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] RBAC: Adding query filter params (type=image) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:28.113361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:28.114764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d887f7e-3ec7-4b9b-b4da-bf666efed3f3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:28.124433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 521/1050] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:27 2022] GET /identity/v3/services?type=image => generated 350 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:28.126172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:28.223612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:28.227190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77419ca-c9e1-4fdd-b6ca-6883c401b718 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:28.261514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed4cb7e-85e2-4dc9-90ca-c52d7861703c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:28.262261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4cb7e-85e2-4dc9-90ca-c52d7861703c None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:28.262546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4cb7e-85e2-4dc9-90ca-c52d7861703c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:28.262824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed4cb7e-85e2-4dc9-90ca-c52d7861703c None admin] PATH_INFO: `/v3/endpoints` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:28.263576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4cb7e-85e2-4dc9-90ca-c52d7861703c None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:28.264930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed4cb7e-85e2-4dc9-90ca-c52d7861703c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:28.350144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 530/1051] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 16:58:28 2022] POST /identity/v3/endpoints => generated 327 bytes in 218 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:29.019069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2757e-17a8-4c43-a923-976aa50ed993 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.019612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2757e-17a8-4c43-a923-976aa50ed993 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.019612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cc2757e-17a8-4c43-a923-976aa50ed993 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.021137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 522/1052] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:29.026139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1def-cfa4-49ce-99f7-7c2699b21721 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.026434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1def-cfa4-49ce-99f7-7c2699b21721 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.026712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bdf1def-cfa4-49ce-99f7-7c2699b21721 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.044030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4bdf1def-cfa4-49ce-99f7-7c2699b21721 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:29.045238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4bdf1def-cfa4-49ce-99f7-7c2699b21721 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:29.120278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 531/1053] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:29.142017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2757e-17a8-4c43-a923-976aa50ed993 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.153779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.247269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cc2757e-17a8-4c43-a923-976aa50ed993 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.282545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.283275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.283559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.283838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.287495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb40441-b1ce-48f5-aceb-07bee5c8aab5 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.287949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb40441-b1ce-48f5-aceb-07bee5c8aab5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.288028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb40441-b1ce-48f5-aceb-07bee5c8aab5 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.289545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 532/1054] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:29.294331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.294622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.294736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:29.294909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:29.302735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:29.303699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:29.304557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 523/1055] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:29.309725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.314276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:29.315516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:29.381453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.384834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 533/1056] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:29.408514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.416952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbe76c0c-4b25-4064-9366-59914c936dfa None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.423156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.458416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.459094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.459376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.459653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.460401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:29.460746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:29.462205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:29.476289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 524/1057] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:29.477534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.524217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1a9707-f3b7-4622-bef0-297cb9c4f958 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.565781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.566608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.566891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.567170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.577348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:29.585011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:29.585942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:29.590905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 534/1058] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:29.591668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45cd354-dbc1-4d1b-a4b0-03a3e6fab214 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.592792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.618275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.624741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.626205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.627643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.627643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.638211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:29.639992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:29.658775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:29.659852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:29.661261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:29.661261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:29.661261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:29.661261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:29.661261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 525/1059] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:29.665549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.666329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.696550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30151df-59e3-48ae-93fd-b14bbd336b26 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.730046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.730735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.731002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.731280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.732030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:29.732339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:29.733704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:29.742531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 535/1060] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:29.747928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.769739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46aeaa41-5406-4220-bffc-4ebcff87ccaf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.848077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.848739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.849024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.849304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.850572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:29.850572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:29.851786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:29.864473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 526/1061] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:29.870183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:29.916186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.929857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c575e400-4012-4ba9-b0f3-cb2e0239cb0c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.964349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:29.965224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:29.965504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:29.965780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] PATH_INFO: `/v3/users/4e7aee4bd4f748a89e5e95cc1d7a61ce` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:29.967724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:29.977860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d37902e-4942-4cb9-9222-cfe92e88d060 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:29.979577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] RBAC: Authorizing `identity:get_user(user_id=4e7aee4bd4f748a89e5e95cc1d7a61ce)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:29.981024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:29.982856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 536/1062] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/users/4e7aee4bd4f748a89e5e95cc1d7a61ce => generated 285 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:29.988941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.016798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.017700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.017982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.018281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.025891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.027362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:30.043013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:30.044032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:30.044984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 527/1063] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/users/nova => generated 82 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:30.050654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.097302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6b2c4cd-6ce7-4155-9fcb-3b5e3d5dfafb None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.138341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.138910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.139192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.139462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.154101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12636c0d-e440-4890-b3eb-5b309985ad35 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.155692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.191805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.192505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.192795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.193071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.193906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:30.194313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.195745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.202214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.212222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.213654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.214370 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 528/1064] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:30.220390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.321129 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9392c8c4-a580-47bb-b436-9eb9d27ccadb None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.326148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 537/1065] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 16:58:30.327182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.361345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.362166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.362448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.362725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.373017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.374489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:30.392923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:30.393829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:30.394777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:30.394777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:30.394777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:30.394777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:30.398910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 529/1066] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:30.399803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.414306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.421495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.429925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f0c478-1e87-4413-80d3-5bd314d32cfa None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.463547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31328d20-f067-49ee-b15b-54d6ee24f77d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.464401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328d20-f067-49ee-b15b-54d6ee24f77d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.464680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328d20-f067-49ee-b15b-54d6ee24f77d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.464957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31328d20-f067-49ee-b15b-54d6ee24f77d None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.466225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328d20-f067-49ee-b15b-54d6ee24f77d None admin] RBAC: Authorizing `identity:get_project(project_id=24d815e173664ddda0d9fa192f7419ea)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.467647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31328d20-f067-49ee-b15b-54d6ee24f77d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.469898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 538/1067] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea => generated 311 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:30.471091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96d62b-bac9-43c8-9b76-79a4e98cd552 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.471374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96d62b-bac9-43c8-9b76-79a4e98cd552 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.471640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d96d62b-bac9-43c8-9b76-79a4e98cd552 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.474170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 539/1068] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:30.476139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96d62b-bac9-43c8-9b76-79a4e98cd552 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.499785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3646b6-9ab2-4133-9b70-033e33ef46d9 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.535696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.536367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.536657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.536941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.537670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:30.537978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.539387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31816422-ab41-4ed3-b495-791a9bd84eca None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.553786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 530/1069] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:30.555062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.555355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.555635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.571811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:30.572993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:30.581694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d96d62b-bac9-43c8-9b76-79a4e98cd552 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.613985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.614667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.614946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.615223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.616037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=24d815e173664ddda0d9fa192f7419ea, user.id=4e7aee4bd4f748a89e5e95cc1d7a61ce) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:30.616356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.617764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.623117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 540/1070] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/role_assignments?user.id=4e7aee4bd4f748a89e5e95cc1d7a61ce&scope.project.id=24d815e173664ddda0d9fa192f7419ea&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:30.623877 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.648307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 531/1071] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:30 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:30.654370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.670864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.673569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.743800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe34b7e-06e4-4d10-848d-ab20212a54ca None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.783213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e66a2d0-7a5d-40c6-9c29-b801b6cf9312 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.783782 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.784586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.784878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.785155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.792045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.793481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:30.807409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:30.808321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:30.809283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 541/1072] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:30.814839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:30.830395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.831046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.831325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.831603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.901649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.903078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.904908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.907698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:30.924522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5aea748-93f8-4dfc-b871-66c2f5731856 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:30.958485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:30.959150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:30.959439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:30.959717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:30.960509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:30.960818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:30.962274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:30.974387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 542/1073] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:30.980113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:31.012534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 532/1074] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:30 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) Jul 06 16:58:31.013700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:31.093284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ef69a4-f432-4923-9727-10bc04a5b1f1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:31.121806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05c21b2d-74a4-444b-baa6-80f07ed6dd91 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:31.123544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:31.131513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a6134f1-8fe1-40a3-b122-4a6772dbaef0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:31.132449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6134f1-8fe1-40a3-b122-4a6772dbaef0 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:31.134932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6134f1-8fe1-40a3-b122-4a6772dbaef0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:31.134932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a6134f1-8fe1-40a3-b122-4a6772dbaef0 None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/45e533c543494ad2a9a294458fa79d14/roles/247b141885a3409e817e172110131f27` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:31.135270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6134f1-8fe1-40a3-b122-4a6772dbaef0 None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=45e533c543494ad2a9a294458fa79d14, role_id=247b141885a3409e817e172110131f27)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:31.136661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a6134f1-8fe1-40a3-b122-4a6772dbaef0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:31.158739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:31.159491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:31.159769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:31.160041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:31.169849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:31.171311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:31.189341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:31.190468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:31.191413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:31.191413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:31.191413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:31.191413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:31.191413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 533/1075] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:31.196293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:31.240712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 543/1076] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:58:30 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/45e533c543494ad2a9a294458fa79d14/roles/247b141885a3409e817e172110131f27 => generated 0 bytes in 261 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:58:31.311392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f972d67e-8a25-40c5-9a3b-1c67ad75efb4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:31.348920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:31.349600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:31.349882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:31.350189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:31.350922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:31.351231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:31.352629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61755cb6-865e-43c5-8659-ce0886dae3c2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:31.370066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 534/1077] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:32.629328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de267bc-d73e-416d-b3ff-8e5e3678bce4 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:32.629832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de267bc-d73e-416d-b3ff-8e5e3678bce4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:32.629920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de267bc-d73e-416d-b3ff-8e5e3678bce4 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:32.631542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 544/1078] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:32.636905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:32.637309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:32.637531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:32.653771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:32.654983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:32.663912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:32.720131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 535/1079] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:32.742869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de267bc-d73e-416d-b3ff-8e5e3678bce4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:32.746775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:32.842618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de267bc-d73e-416d-b3ff-8e5e3678bce4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:32.876118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:32.876906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:32.877189 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:32.877465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:32.887748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:32.895406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:32.896514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:32.897570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:32.898568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 545/1080] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:32.902724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:32.999403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f5a31d1-b4dd-4650-ab43-e1be64c69951 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.032683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.033355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.033640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.033920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.034706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:33.035015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:33.036395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:33.044588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 536/1081] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 16:58:33.051190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.115427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:33.152336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94b71575-c6a4-456d-ac1e-2273539a185a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.186289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9889112-19ee-4d02-9682-33c4b954fdd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.187152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889112-19ee-4d02-9682-33c4b954fdd9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.187458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889112-19ee-4d02-9682-33c4b954fdd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.187732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9889112-19ee-4d02-9682-33c4b954fdd9 None admin] PATH_INFO: `/v3/users/4e7aee4bd4f748a89e5e95cc1d7a61ce` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.188910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9889112-19ee-4d02-9682-33c4b954fdd9 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7aee4bd4f748a89e5e95cc1d7a61ce)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:33.190402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9889112-19ee-4d02-9682-33c4b954fdd9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:33.192024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 546/1082] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:33 2022] GET /identity/v3/users/4e7aee4bd4f748a89e5e95cc1d7a61ce => generated 285 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:33.197695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.208255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:33.269247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbde98-5ac4-4bc9-aadc-a5f248c5fa4c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.269523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbde98-5ac4-4bc9-aadc-a5f248c5fa4c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.269793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bbde98-5ac4-4bc9-aadc-a5f248c5fa4c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.271158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 547/1083] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:58:33.275992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.276277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.276549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.293737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:33.294960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:33.298726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-018dd44d-8565-42b2-97ca-8032000c2ed1 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.331371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.332219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.332498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.332767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.333916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] RBAC: Authorizing `identity:get_project(project_id=24d815e173664ddda0d9fa192f7419ea)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:33.335374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:33.337044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 537/1084] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:33 2022] GET /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea => generated 311 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:33.342806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.364870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 548/1085] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:33 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Jul 06 16:58:33.388282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.416453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:33.441992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c01bbc-8806-47e2-a958-cde780188a2d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.447407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:33.475486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.476376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.476658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.476958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea/users/4e7aee4bd4f748a89e5e95cc1d7a61ce/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.479074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d815e173664ddda0d9fa192f7419ea, user_id=4e7aee4bd4f748a89e5e95cc1d7a61ce, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:33.480508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:33.485756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c4ceee-f9ea-4250-9a81-85455720e962 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.519636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.520427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.520709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.520984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.533971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 538/1086] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:58:33 2022] PUT /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea/users/4e7aee4bd4f748a89e5e95cc1d7a61ce/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 16:58:33.534159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:33.540058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:33.541311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:33.542399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 549/1087] 10.222.0.20 () {56 vars in 1120 bytes} [Wed Jul 6 16:58:33 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:33.548104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.653115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ca9b0a-fdf5-444d-983f-b89b249a5bc2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.689364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.690047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.690359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.690641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.691401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:33.691708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:33.693077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:33.694520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:33.702161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 539/1088] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:58:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:33.708516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.813439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49e1791-33de-4931-8c01-bfc178301c13 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:33.834779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:33.846082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:33.849640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:33.849640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:33.849640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:33.857795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:33.859816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:33.876893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:33.877862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:33.878857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:33.878857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:33.878857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:33.878857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:33.878857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 550/1089] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:33.884187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:33.981884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbe817b-87b2-4bba-82ed-c3aad718a039 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:34.015998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:34.016660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:34.016945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:34.017233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:34.017980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:34.018326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:34.019691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:34.030816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 540/1090] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:34.036987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:34.133506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8b91226-4d2e-4b9c-9589-e0d574d4767f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:34.166918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:34.167706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:34.167990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:34.168263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] PATH_INFO: `/v3/users/nova` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:34.175686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:34.177117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 16:58:34.190827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:34.191965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:34.193302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 551/1091] 10.222.0.20 () {56 vars in 1093 bytes} [Wed Jul 6 16:58:34 2022] GET /identity/v3/users/nova => generated 82 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:34.197713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:34.253603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:34.297350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d079929d-3d0e-4d42-973a-85384a493b14 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:34.330174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:34.330837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:34.331119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:34.331399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:34.332225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:34.332533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:34.333963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:34.350389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 541/1092] 10.222.0.20 () {56 vars in 1133 bytes} [Wed Jul 6 16:58:34 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:34.356113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:34.391598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:34.454729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2090de-1e81-454a-b920-182d866f3edf None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:34.486508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:34.487146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:34.487432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:34.487710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:34.555057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:34.556504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:34.588863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:34.655190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 552/1093] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:34 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:34.660852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:34.758586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54767bf9-e3e7-4614-91f0-e526712f9296 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:34.772128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:34.791276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:34.792060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:34.792344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:34.792619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:34.802965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:34.804453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:58:34.822654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:34.823517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:34.824515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 16:58:34.824515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:58:34.824515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 16:58:34.824515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:34.824515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 542/1094] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 16:58:34.829503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:34.925747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ae5247-5ee8-4ce8-bac9-f214ca30a04a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:34.958696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:34.959358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:34.959639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:34.959914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:34.960634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:34.960941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:34.962335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:34.963767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:34.973842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 553/1095] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 16:58:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:34.979324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:35.077919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae937b6-ad0a-4d3a-8147-0af8992983c0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:35.113451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:35.114268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.114557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.114835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.121419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:35.122898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 16:58:35.136668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:35.137720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:58:35.138686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 543/1096] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 16:58:34 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:35.143591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:35.242324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed286b74-12e1-4e65-8109-390c02ab485a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:35.275314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:35.275970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.276254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.276573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.277318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:35.277630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:35.279106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12649bdc-40ff-4a50-8994-1ac20e2a1974 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:35.291498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 554/1097] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 16:58:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:35.298006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:35.325408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:35.396912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88198ffd-410a-4ae0-aa25-5dac4320a53f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:35.430826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:35.431479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.431765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.432045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.432875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] RBAC: Adding query filter params (role.id=247b141885a3409e817e172110131f27, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=45e533c543494ad2a9a294458fa79d14) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:35.433189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:35.434657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18c7f25-0a77-46c5-b5da-6b9b51314fc3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:35.440516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 544/1098] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:35 2022] GET /identity/v3/role_assignments?user.id=45e533c543494ad2a9a294458fa79d14&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=247b141885a3409e817e172110131f27 => generated 608 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:35.535829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29fa1-0d18-4780-be71-69e7cf4a46b3 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.536117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29fa1-0d18-4780-be71-69e7cf4a46b3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.536397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84c29fa1-0d18-4780-be71-69e7cf4a46b3 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.537776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 555/1099] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:35.543627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.543917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.544198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.561867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:35.563200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:35.633119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 545/1100] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:35.657343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c29fa1-0d18-4780-be71-69e7cf4a46b3 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:35.716828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:35.760484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84c29fa1-0d18-4780-be71-69e7cf4a46b3 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:35.796201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:35.797001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.797287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.797564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.807946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:35.816113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:35.817254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:35.818201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 556/1101] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:35.823342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:35.845745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:35.924308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7f8e5b-4cf1-4357-8c54-c04f2b60566b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:35.960363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:35.961032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:35.961317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:35.961598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:35.962378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:35.962687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:35.964065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:35.973104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 546/1102] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:35.978684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:36.083698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15ad2580-4d6e-4ba3-8160-e5cf191c149e None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:36.097088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:36.116808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:36.117750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:36.118054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:36.118355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] PATH_INFO: `/v3/users/4e7aee4bd4f748a89e5e95cc1d7a61ce` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:36.119550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] RBAC: Authorizing `identity:get_user(user_id=4e7aee4bd4f748a89e5e95cc1d7a61ce)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:36.121441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:36.122644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 557/1103] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:35 2022] GET /identity/v3/users/4e7aee4bd4f748a89e5e95cc1d7a61ce => generated 285 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:36.129041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:36.215038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:36.232687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c370ee5-4571-43ee-9293-5d6b2d9ec51e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:36.268109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:36.268762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:36.269049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:36.269330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:36.335018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:36.336481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:36.412097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:36.430084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 547/1104] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:36.435968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:36.531689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58bff1b3-9714-46f7-a3c1-6625c4c389d4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:36.564995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91ab4350-4777-4288-b0ba-c6bdc872efc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:36.565843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab4350-4777-4288-b0ba-c6bdc872efc0 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:36.566164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab4350-4777-4288-b0ba-c6bdc872efc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:36.566442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91ab4350-4777-4288-b0ba-c6bdc872efc0 None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:36.567629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab4350-4777-4288-b0ba-c6bdc872efc0 None admin] RBAC: Authorizing `identity:get_project(project_id=24d815e173664ddda0d9fa192f7419ea)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:36.569049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91ab4350-4777-4288-b0ba-c6bdc872efc0 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:36.570760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 558/1105] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:36 2022] GET /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:36.576780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:36.672519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326335bb-26aa-43b2-878b-8b5e0a25e254 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:36.704339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:36.704974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:36.705258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:36.705532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:36.706376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=24d815e173664ddda0d9fa192f7419ea, user.id=4e7aee4bd4f748a89e5e95cc1d7a61ce) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:36.706684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:36.708085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1a2201b-1343-4a15-b52a-cb22343651f8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:36.713657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 548/1106] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:36 2022] GET /identity/v3/role_assignments?user.id=4e7aee4bd4f748a89e5e95cc1d7a61ce&scope.project.id=24d815e173664ddda0d9fa192f7419ea&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:38.738296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc466-a71a-4e03-8dae-fa8a812db1e3 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:38.744108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc466-a71a-4e03-8dae-fa8a812db1e3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:38.744108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411fc466-a71a-4e03-8dae-fa8a812db1e3 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:38.744108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 559/1107] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:38.745252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:38.745630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:38.745830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:38.763059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:38.764238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:38.809668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:38.833419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 549/1108] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:38 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:38.858543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc466-a71a-4e03-8dae-fa8a812db1e3 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:38.908167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:38.956307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411fc466-a71a-4e03-8dae-fa8a812db1e3 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:38.988606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fe81821-5194-4e8c-bb39-67f39134e4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:38.989369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe81821-5194-4e8c-bb39-67f39134e4bf None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:38.989648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe81821-5194-4e8c-bb39-67f39134e4bf None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:38.989919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fe81821-5194-4e8c-bb39-67f39134e4bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:38.991085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe81821-5194-4e8c-bb39-67f39134e4bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:38.992497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fe81821-5194-4e8c-bb39-67f39134e4bf None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:38.994154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 560/1109] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:38.999625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:39.094830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6da20a6b-54db-439d-833a-a269de8208a6 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:39.127753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f50c2dd3-137d-4bd7-91ef-be024ef7f4be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:39.128406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2dd3-137d-4bd7-91ef-be024ef7f4be None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:39.128687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2dd3-137d-4bd7-91ef-be024ef7f4be None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:39.128963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f50c2dd3-137d-4bd7-91ef-be024ef7f4be None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:39.129658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c2dd3-137d-4bd7-91ef-be024ef7f4be None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:39.131359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f50c2dd3-137d-4bd7-91ef-be024ef7f4be None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:39.224960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 550/1110] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:58:38 2022] POST /identity/v3/users => generated 286 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:41.249427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa087ae-5f41-4886-ac67-8d840f9b9034 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:41.250008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa087ae-5f41-4886-ac67-8d840f9b9034 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:41.250008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fa087ae-5f41-4886-ac67-8d840f9b9034 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:41.251355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 561/1111] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:41.256617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:41.257060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:41.257170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:41.273533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:41.274783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:41.300647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:41.339982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 551/1112] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:41.363758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa087ae-5f41-4886-ac67-8d840f9b9034 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:41.460995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fa087ae-5f41-4886-ac67-8d840f9b9034 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:41.477476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:41.493411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:41.499778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:41.499778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:41.499778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] PATH_INFO: `/v3/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:41.499778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] RBAC: Authorizing `identity:get_role(role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:41.499778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:41.499778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 562/1113] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:41 2022] GET /identity/v3/roles/f63a187bba4e41e586f5700d586f8a89 => generated 223 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:41.504672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:41.600439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3de11180-78f1-4eac-9888-940ed16e2856 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:41.632784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:41.633643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:41.633928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:41.634231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] PATH_INFO: `/v3/users/fc8692b6fe104e079433a6642671efb0` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:41.647317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] RBAC: Authorizing `identity:get_user(user_id=fc8692b6fe104e079433a6642671efb0)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:41.648771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:41.650477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 552/1114] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:41 2022] GET /identity/v3/users/fc8692b6fe104e079433a6642671efb0 => generated 286 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:41.656724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:41.751584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bb1e5a1-526f-4450-a838-6e5add2f1f6d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:41.867134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:41.867757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:41.868037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:41.868309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:41.920443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:41.932944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:41.934507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:42.028868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 563/1115] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:41 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 373 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:42.034849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:42.056177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:42.131648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f288dda8-ed93-460c-8347-8305e765818d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:42.164079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39979403-7be4-4a40-8129-90fcd081abe0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:42.164935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39979403-7be4-4a40-8129-90fcd081abe0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:42.165216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39979403-7be4-4a40-8129-90fcd081abe0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:42.165491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39979403-7be4-4a40-8129-90fcd081abe0 None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:42.166668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39979403-7be4-4a40-8129-90fcd081abe0 None admin] RBAC: Authorizing `identity:get_project(project_id=24d815e173664ddda0d9fa192f7419ea)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:42.168099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39979403-7be4-4a40-8129-90fcd081abe0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:42.169759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 553/1116] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:42 2022] GET /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:42.176216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:42.255804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:42.269712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6a65b9-26b6-4144-a3c1-8ae9307fad49 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:42.302486 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:42.303075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:42.303356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:42.303630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:42.304451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] RBAC: Adding query filter params (role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=24d815e173664ddda0d9fa192f7419ea, user.id=fc8692b6fe104e079433a6642671efb0) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:42.304762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:42.306204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f7bdcc-9722-4475-93ba-49bab4fea10c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:42.311498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 564/1117] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:42 2022] GET /identity/v3/role_assignments?user.id=fc8692b6fe104e079433a6642671efb0&scope.project.id=24d815e173664ddda0d9fa192f7419ea&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 259 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:44.292490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce2d8-a2a8-4b7f-a074-999377cfc71b None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:44.293068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce2d8-a2a8-4b7f-a074-999377cfc71b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:44.293068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cce2d8-a2a8-4b7f-a074-999377cfc71b None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:44.294449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 554/1118] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:44.300361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:44.300769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:44.300908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:44.317753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:44.319031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:44.383035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 565/1119] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:44.405969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce2d8-a2a8-4b7f-a074-999377cfc71b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:44.491731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:44.504614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cce2d8-a2a8-4b7f-a074-999377cfc71b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:44.536908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:44.537789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:44.538274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:44.538779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] PATH_INFO: `/v3/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:44.540694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] RBAC: Authorizing `identity:get_role(role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:44.542128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:44.543563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 555/1120] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:44 2022] GET /identity/v3/roles/f63a187bba4e41e586f5700d586f8a89 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:44.549702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:44.627082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:44.645097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd95926-7325-43a5-bfdc-32cc3952aef8 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:44.677494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:44.678378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:44.678658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:44.678929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] PATH_INFO: `/v3/users/fc8692b6fe104e079433a6642671efb0` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:44.680080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] RBAC: Authorizing `identity:get_user(user_id=fc8692b6fe104e079433a6642671efb0)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:44.681483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:44.683089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 566/1121] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:44 2022] GET /identity/v3/users/fc8692b6fe104e079433a6642671efb0 => generated 286 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:44.689696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:44.784598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2874f63a-90bb-4362-a4b7-a161ae221724 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:44.817558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b1dcc21-a445-466a-8ed3-8266a41f0a1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:44.818418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dcc21-a445-466a-8ed3-8266a41f0a1c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:44.818703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dcc21-a445-466a-8ed3-8266a41f0a1c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:44.818977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b1dcc21-a445-466a-8ed3-8266a41f0a1c None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:44.820134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dcc21-a445-466a-8ed3-8266a41f0a1c None admin] RBAC: Authorizing `identity:get_project(project_id=24d815e173664ddda0d9fa192f7419ea)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:44.821547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b1dcc21-a445-466a-8ed3-8266a41f0a1c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:44.823223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 556/1122] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:44 2022] GET /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:44.828982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:44.924935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5416c41-5888-49cc-b27d-48ce550f8123 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:44.956636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d8d45d-29de-4662-abca-1508528892a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:44.957526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d45d-29de-4662-abca-1508528892a4 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:44.957808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d45d-29de-4662-abca-1508528892a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:44.958115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d8d45d-29de-4662-abca-1508528892a4 None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea/users/fc8692b6fe104e079433a6642671efb0/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:44.960276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8d45d-29de-4662-abca-1508528892a4 None admin] RBAC: Authorizing `identity:create_grant(project_id=24d815e173664ddda0d9fa192f7419ea, user_id=fc8692b6fe104e079433a6642671efb0, role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:44.961685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d8d45d-29de-4662-abca-1508528892a4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:45.018322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 567/1123] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:58:44 2022] PUT /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea/users/fc8692b6fe104e079433a6642671efb0/roles/f63a187bba4e41e586f5700d586f8a89 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:58:46.994471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a9603-e5aa-4fc0-8e52-bb6ecf91c351 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:46.995015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a9603-e5aa-4fc0-8e52-bb6ecf91c351 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:46.995015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458a9603-e5aa-4fc0-8e52-bb6ecf91c351 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:46.996381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 557/1124] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:47.002165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:47.002558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:47.002720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:47.019061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:47.020225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:47.022140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:47.085253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 568/1125] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:47.114849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a9603-e5aa-4fc0-8e52-bb6ecf91c351 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:47.139523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:47.214117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458a9603-e5aa-4fc0-8e52-bb6ecf91c351 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:47.247107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:47.247889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:47.248172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:47.248449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] PATH_INFO: `/v3/roles/f63a187bba4e41e586f5700d586f8a89` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:47.249923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] RBAC: Authorizing `identity:get_role(role_id=f63a187bba4e41e586f5700d586f8a89)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:47.251365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:47.252709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 558/1126] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:47 2022] GET /identity/v3/roles/f63a187bba4e41e586f5700d586f8a89 => generated 223 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:47.258621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:47.357797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4555979-e5c1-4113-9905-399e33cbe8e7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:47.391816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:47.392665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:47.392949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:47.393223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] PATH_INFO: `/v3/users/fc8692b6fe104e079433a6642671efb0` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:47.394425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] RBAC: Authorizing `identity:get_user(user_id=fc8692b6fe104e079433a6642671efb0)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:47.395876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:47.397482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 569/1127] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:47 2022] GET /identity/v3/users/fc8692b6fe104e079433a6642671efb0 => generated 286 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:47.403072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:47.491086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:47.499401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b80ca7-7401-4ec1-a86c-866fe4d2bf61 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:47.532098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:47.532751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:47.533035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:47.533318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:47.598789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:47.600253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:47.685768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:47.695269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 559/1128] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:47.701093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:47.712329 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:47.796880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6bff54c-016d-4452-8c92-393b50af43a3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:47.828736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd1665ed-9dc4-4bc3-b380-b5d34dd166b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:47.829571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1665ed-9dc4-4bc3-b380-b5d34dd166b1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:47.829846 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1665ed-9dc4-4bc3-b380-b5d34dd166b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:47.830141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd1665ed-9dc4-4bc3-b380-b5d34dd166b1 None admin] PATH_INFO: `/v3/projects/24d815e173664ddda0d9fa192f7419ea` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:47.831290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1665ed-9dc4-4bc3-b380-b5d34dd166b1 None admin] RBAC: Authorizing `identity:get_project(project_id=24d815e173664ddda0d9fa192f7419ea)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:47.832699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd1665ed-9dc4-4bc3-b380-b5d34dd166b1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:47.834375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 570/1129] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:47 2022] GET /identity/v3/projects/24d815e173664ddda0d9fa192f7419ea => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:47.840381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:47.936042 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7d6fe7-e9f8-478f-8d00-0b3c11cfa426 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:47.968759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:47.969390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:47.969666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:47.969935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:47.970775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] RBAC: Adding query filter params (role.id=f63a187bba4e41e586f5700d586f8a89, scope.project.id=24d815e173664ddda0d9fa192f7419ea, user.id=fc8692b6fe104e079433a6642671efb0) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:47.971082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:47.972490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d477c85c-35b7-4072-885f-89a9cb8c9192 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:47.978033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 560/1130] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:47 2022] GET /identity/v3/role_assignments?user.id=fc8692b6fe104e079433a6642671efb0&scope.project.id=24d815e173664ddda0d9fa192f7419ea&role.id=f63a187bba4e41e586f5700d586f8a89 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:49.988828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41282862-13cd-472c-897f-e979db190649 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:49.989370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41282862-13cd-472c-897f-e979db190649 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:49.989370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41282862-13cd-472c-897f-e979db190649 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:49.990759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 571/1131] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:49.995893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:49.996308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:49.996498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:50.013166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:50.014362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:50.062877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:50.079043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 561/1132] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:49 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:50.102286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41282862-13cd-472c-897f-e979db190649 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:50.175062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:50.199935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41282862-13cd-472c-897f-e979db190649 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:50.232557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e06026c-ae0e-43ad-ace9-56ce99c6658a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:50.233326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06026c-ae0e-43ad-ace9-56ce99c6658a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:50.233609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06026c-ae0e-43ad-ace9-56ce99c6658a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:50.233912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e06026c-ae0e-43ad-ace9-56ce99c6658a None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:50.235098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06026c-ae0e-43ad-ace9-56ce99c6658a None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:50.236531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e06026c-ae0e-43ad-ace9-56ce99c6658a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:50.238135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 572/1133] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:50 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:50.243813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:50.339248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227cead2-c3d1-4c73-8b2d-e9c1f10bfac9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:50.371246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8c0ec71-93b3-40c6-856b-6825a9e2e827 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:50.371893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0ec71-93b3-40c6-856b-6825a9e2e827 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:50.372178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0ec71-93b3-40c6-856b-6825a9e2e827 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:50.372461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8c0ec71-93b3-40c6-856b-6825a9e2e827 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:50.373179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0ec71-93b3-40c6-856b-6825a9e2e827 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:50.375155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8c0ec71-93b3-40c6-856b-6825a9e2e827 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:50.476494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 562/1134] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:58:50 2022] POST /identity/v3/projects => generated 311 bytes in 233 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:52.504451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe402-dbd7-4ac8-bb3f-e762ea394ad6 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:52.504978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe402-dbd7-4ac8-bb3f-e762ea394ad6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:52.504978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02fe402-dbd7-4ac8-bb3f-e762ea394ad6 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:52.506626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 573/1135] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:52.511725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:52.512126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:52.512292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:52.529355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:52.531112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:52.561145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:52.596792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 563/1136] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:52.621446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe402-dbd7-4ac8-bb3f-e762ea394ad6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:52.718151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02fe402-dbd7-4ac8-bb3f-e762ea394ad6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:52.750174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf28372d-846f-4be7-96f6-bf94d695520d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:52.750940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28372d-846f-4be7-96f6-bf94d695520d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:52.751217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28372d-846f-4be7-96f6-bf94d695520d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:52.751488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf28372d-846f-4be7-96f6-bf94d695520d None admin] PATH_INFO: `/v3/domains/default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:52.752639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28372d-846f-4be7-96f6-bf94d695520d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:52.754069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf28372d-846f-4be7-96f6-bf94d695520d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:52.755943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 574/1137] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 16:58:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:52.761436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:52.856620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72126d1a-dd44-4ed3-9f78-d79ffb3e903f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:52.889606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8044f43f-dd2c-4276-9309-bf5d8f7a1a60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:52.890814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f43f-dd2c-4276-9309-bf5d8f7a1a60 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:52.891099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f43f-dd2c-4276-9309-bf5d8f7a1a60 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:52.891376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8044f43f-dd2c-4276-9309-bf5d8f7a1a60 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:52.892079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f43f-dd2c-4276-9309-bf5d8f7a1a60 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:52.893526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8044f43f-dd2c-4276-9309-bf5d8f7a1a60 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:52.989997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 564/1138] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:58:52 2022] POST /identity/v3/users => generated 286 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:58:55.006174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebd36-d070-46f7-8e3b-7defe2b7c04a None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:55.006736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebd36-d070-46f7-8e3b-7defe2b7c04a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:55.006736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377ebd36-d070-46f7-8e3b-7defe2b7c04a None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:55.008073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 575/1139] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:55.013233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:55.013639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:55.013797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:55.030557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:55.032326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:55.049506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:55.097200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 565/1140] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:55.120713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebd36-d070-46f7-8e3b-7defe2b7c04a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:55.133602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:55.220308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377ebd36-d070-46f7-8e3b-7defe2b7c04a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:55.254231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:55.255003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:55.255543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:55.255824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:55.265717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:55.273412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:55.274613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:55.275709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 576/1141] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:55.280582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:55.377117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21bafc-5c91-446a-881a-5d6ed65660dd None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:55.410304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:55.410959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:55.411245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:55.411523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:55.412264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:55.412571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:55.413931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:55.422596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 566/1142] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:55 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:55.428002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:55.494579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:55.523578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ebfaab0-24c0-4729-99c1-0c9b9769419d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:55.556764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:55.557638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:55.557925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:55.558232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] PATH_INFO: `/v3/users/dafe4ca58529474fba6023e9f3e683e8` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:55.571205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] RBAC: Authorizing `identity:get_user(user_id=dafe4ca58529474fba6023e9f3e683e8)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:55.572645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:55.574318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 577/1143] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:55 2022] GET /identity/v3/users/dafe4ca58529474fba6023e9f3e683e8 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:55.579972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:55.598276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:55.680616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e53a223-4d80-4144-8fa3-c8b68b114379 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:55.712877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:55.713509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:55.713790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:55.714098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:55.779372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:55.781333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:55.798143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:55.876930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 567/1144] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:58:55 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:58:55.883025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:55.978876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a01e29-dc95-4049-9663-88a490fee8bf None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:56.004922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:56.012544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff56394f-d457-404f-878a-69d215b63eff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:56.013384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56394f-d457-404f-878a-69d215b63eff None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:56.013669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56394f-d457-404f-878a-69d215b63eff None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:56.013954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff56394f-d457-404f-878a-69d215b63eff None admin] PATH_INFO: `/v3/projects/1ba9327b78874e58b3576f636ad29604` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:56.015197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56394f-d457-404f-878a-69d215b63eff None admin] RBAC: Authorizing `identity:get_project(project_id=1ba9327b78874e58b3576f636ad29604)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:56.016618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff56394f-d457-404f-878a-69d215b63eff None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:56.018312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 578/1145] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:55 2022] GET /identity/v3/projects/1ba9327b78874e58b3576f636ad29604 => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:56.024410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:56.121167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc148f31-4752-47c0-8899-4bfe504f0033 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:56.136726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:56.153618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:56.154293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:56.154580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:56.154859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:56.156216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=1ba9327b78874e58b3576f636ad29604, user.id=dafe4ca58529474fba6023e9f3e683e8) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:56.156529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:56.157951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df20ab19-c3db-4397-93b2-86c819dfacda None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:56.163474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 568/1146] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:58:56 2022] GET /identity/v3/role_assignments?user.id=dafe4ca58529474fba6023e9f3e683e8&scope.project.id=1ba9327b78874e58b3576f636ad29604&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:58.114995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989e7e-2bcc-42bd-bcb8-ad4167adbc24 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.115543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989e7e-2bcc-42bd-bcb8-ad4167adbc24 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.115543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8989e7e-2bcc-42bd-bcb8-ad4167adbc24 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.116911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 579/1147] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:58:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:58:58.122086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.122477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.122654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.139809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:58:58.141003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:58:58.204733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 569/1148] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:58:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:58:58.226885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989e7e-2bcc-42bd-bcb8-ad4167adbc24 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:58.325823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8989e7e-2bcc-42bd-bcb8-ad4167adbc24 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:58.359339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:58.360111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.360394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.360669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.370644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:58:58.378241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:58:58.379326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:58:58.380629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 580/1149] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:58:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:58:58.385685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:58.481155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6e674f-240a-432e-b0da-0bde1b96e83e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:58.491987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:58.514506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:58.515195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.517826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.517826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.517826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:58:58.517826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:58.518168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:58.525916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 570/1150] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:58:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:58.532410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:58.586667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:58.629552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c6ae12-ebf2-495d-9789-91d9745b3e4b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:58.662003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:58.662885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.663165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.663436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] PATH_INFO: `/v3/users/dafe4ca58529474fba6023e9f3e683e8` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.664595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] RBAC: Authorizing `identity:get_user(user_id=dafe4ca58529474fba6023e9f3e683e8)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:58.666011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:58.667638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 581/1151] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:58:58 2022] GET /identity/v3/users/dafe4ca58529474fba6023e9f3e683e8 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:58.673953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:58.769992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bfccff7-0092-4552-a88e-91514e6611b2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:58.802150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da51748a-1e08-4f0e-9d47-0bab13fe9ab8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:58.803006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51748a-1e08-4f0e-9d47-0bab13fe9ab8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.803290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51748a-1e08-4f0e-9d47-0bab13fe9ab8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.803569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da51748a-1e08-4f0e-9d47-0bab13fe9ab8 None admin] PATH_INFO: `/v3/projects/1ba9327b78874e58b3576f636ad29604` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.804730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51748a-1e08-4f0e-9d47-0bab13fe9ab8 None admin] RBAC: Authorizing `identity:get_project(project_id=1ba9327b78874e58b3576f636ad29604)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:58.806191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da51748a-1e08-4f0e-9d47-0bab13fe9ab8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:58.807857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 571/1152] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:58:58 2022] GET /identity/v3/projects/1ba9327b78874e58b3576f636ad29604 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:58:58.813481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:58:58.909252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feee3f2b-8f1a-48fd-855c-48c46fdb7c6d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:58:58.930748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:58:58.940775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b37512-c99c-43d6-b2dd-db1c03c24cbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:58:58.941638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37512-c99c-43d6-b2dd-db1c03c24cbb None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:58:58.941914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37512-c99c-43d6-b2dd-db1c03c24cbb None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:58:58.942218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b37512-c99c-43d6-b2dd-db1c03c24cbb None admin] PATH_INFO: `/v3/projects/1ba9327b78874e58b3576f636ad29604/users/dafe4ca58529474fba6023e9f3e683e8/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:58:58.944131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37512-c99c-43d6-b2dd-db1c03c24cbb None admin] RBAC: Authorizing `identity:create_grant(project_id=1ba9327b78874e58b3576f636ad29604, user_id=dafe4ca58529474fba6023e9f3e683e8, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:58:58.945535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b37512-c99c-43d6-b2dd-db1c03c24cbb None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:58:59.038197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 582/1153] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:58:58 2022] PUT /identity/v3/projects/1ba9327b78874e58b3576f636ad29604/users/dafe4ca58529474fba6023e9f3e683e8/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:59:01.009159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec4035-2290-41b2-be23-315dbc91e79a None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.009716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec4035-2290-41b2-be23-315dbc91e79a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.009716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ec4035-2290-41b2-be23-315dbc91e79a None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.011138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 572/1154] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:01.016648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.017012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.017211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.033990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:01.035195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:01.097911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 583/1155] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:01.121043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec4035-2290-41b2-be23-315dbc91e79a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:01.162774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:01.220242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ec4035-2290-41b2-be23-315dbc91e79a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:01.253441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:01.254235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.254520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.254796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.264721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:59:01.272296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:59:01.273219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:59:01.274144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 573/1156] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:59:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:59:01.279429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:01.375575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b4f1d49-5bf0-44ee-a26a-be32b9b83b07 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:01.389092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:01.408455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:01.409111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.409396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.409675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.410447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:01.410758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:01.412114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:01.420535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 584/1157] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:59:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:01.426277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:01.518718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:01.521457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46e58d2d-c460-49ff-985a-019a1f33aa5f None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:01.555146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:01.556002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.556282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.556556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] PATH_INFO: `/v3/users/dafe4ca58529474fba6023e9f3e683e8` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.557715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] RBAC: Authorizing `identity:get_user(user_id=dafe4ca58529474fba6023e9f3e683e8)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:01.559175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:01.560783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 574/1158] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:59:01 2022] GET /identity/v3/users/dafe4ca58529474fba6023e9f3e683e8 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:01.566423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:01.663884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bd882bd-ff6b-4fcc-a89c-4b5e4a90a623 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:01.696103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:01.696733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.697019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.697298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.740391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:01.761880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:01.763360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:01.858279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 585/1159] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:59:01 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:59:01.864042 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:01.959194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8820e77-07c0-413f-ac2a-a93aba686145 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:01.991760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13689375-0e05-4a42-9de2-bca9b0291d5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:01.992588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13689375-0e05-4a42-9de2-bca9b0291d5e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:01.992869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13689375-0e05-4a42-9de2-bca9b0291d5e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:01.993141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13689375-0e05-4a42-9de2-bca9b0291d5e None admin] PATH_INFO: `/v3/projects/1ba9327b78874e58b3576f636ad29604` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:01.994310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13689375-0e05-4a42-9de2-bca9b0291d5e None admin] RBAC: Authorizing `identity:get_project(project_id=1ba9327b78874e58b3576f636ad29604)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:01.995725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13689375-0e05-4a42-9de2-bca9b0291d5e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:01.997350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 575/1160] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:59:01 2022] GET /identity/v3/projects/1ba9327b78874e58b3576f636ad29604 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:02.003493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:02.077382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:02.099479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadac974-9b72-4769-8bb9-9c9772797517 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:02.132463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:02.133038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:02.133326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:02.133604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:02.134454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=1ba9327b78874e58b3576f636ad29604, user.id=dafe4ca58529474fba6023e9f3e683e8) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:02.134766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:02.136182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0a65940-2797-4169-80a9-a7deb9b6be93 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:02.142404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 586/1161] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:59:02 2022] GET /identity/v3/role_assignments?user.id=dafe4ca58529474fba6023e9f3e683e8&scope.project.id=1ba9327b78874e58b3576f636ad29604&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:04.148764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55827-ce8d-4499-ad88-798efcfaa0e0 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:04.149289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55827-ce8d-4499-ad88-798efcfaa0e0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:04.149289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d55827-ce8d-4499-ad88-798efcfaa0e0 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:04.150689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 576/1162] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:04.155719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:04.156150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:04.156276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:04.172855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:04.174016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:04.236504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 587/1163] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:04.258631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55827-ce8d-4499-ad88-798efcfaa0e0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:04.292842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:04.357861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d55827-ce8d-4499-ad88-798efcfaa0e0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:04.390655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:04.391281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:04.391560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:04.391835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:04.455249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:04.456614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:04.488559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:04.551123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 577/1164] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:59:04 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:59:04.556815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:04.621637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:04.650001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c670ff34-8514-4141-9c98-3b336056f3d8 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:04.682930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:04.683710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:04.683992 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:04.684266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:04.690713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:04.692141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3bf27649-2dfe-4f6a-85ea-d8eab353f81a None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:59:04.706545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:59:04.707595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:59:04.708561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 588/1165] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 16:59:04 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:59:04.713358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:04.808392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f1d7e9-e16b-4085-824b-b7dd2fdedca5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:04.840215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:04.840852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:04.841131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:04.841406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:04.842137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:04.842442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:04.844418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c7d3b8e-e483-4b77-9fdb-e8c8927c2ef4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:04.846628 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:04.851580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 578/1166] 10.222.0.20 () {56 vars in 1115 bytes} [Wed Jul 6 16:59:04 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:06.820116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d527db-0b39-46b7-937e-3270c67a07a3 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:06.820616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d527db-0b39-46b7-937e-3270c67a07a3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:06.820729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14d527db-0b39-46b7-937e-3270c67a07a3 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:06.822051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 589/1167] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 16:59:06.827159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f781f-d015-481e-9125-d0635d14d191 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:06.827549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f781f-d015-481e-9125-d0635d14d191 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:06.827749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e90f781f-d015-481e-9125-d0635d14d191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:06.844422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e90f781f-d015-481e-9125-d0635d14d191 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:06.845591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e90f781f-d015-481e-9125-d0635d14d191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:06.909018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 579/1168] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:06 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:06.931613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d527db-0b39-46b7-937e-3270c67a07a3 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:07.031007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14d527db-0b39-46b7-937e-3270c67a07a3 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:07.057684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:07.063226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ec30a4-b157-474b-ac7f-d6dee15654ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:07.063872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec30a4-b157-474b-ac7f-d6dee15654ad None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:07.064153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec30a4-b157-474b-ac7f-d6dee15654ad None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:07.064429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ec30a4-b157-474b-ac7f-d6dee15654ad None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:07.065163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec30a4-b157-474b-ac7f-d6dee15654ad None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:07.066562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ec30a4-b157-474b-ac7f-d6dee15654ad None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:07.139339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 590/1169] 10.222.0.20 () {60 vars in 1138 bytes} [Wed Jul 6 16:59:06 2022] POST /identity/v3/domains => generated 267 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:59:09.138207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5cf5-f33a-4523-8119-644584eebd7f None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:09.138750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5cf5-f33a-4523-8119-644584eebd7f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:09.138750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5c5cf5-f33a-4523-8119-644584eebd7f None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:09.140705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 580/1170] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:09 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:09.145725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:09.146123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:09.146306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:09.162554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:09.163725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:09.227389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 591/1171] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:09 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:09.251276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5cf5-f33a-4523-8119-644584eebd7f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:09.348105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5c5cf5-f33a-4523-8119-644584eebd7f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:09.376145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:09.381808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bec23b-0b26-4a2d-924b-a78fa5593ade None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:09.382675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bec23b-0b26-4a2d-924b-a78fa5593ade None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:09.382955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bec23b-0b26-4a2d-924b-a78fa5593ade None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:09.383228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bec23b-0b26-4a2d-924b-a78fa5593ade None admin] PATH_INFO: `/v3/domains/120c61b0a4014edaaeba91fb90655191` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:09.393373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bec23b-0b26-4a2d-924b-a78fa5593ade None admin] RBAC: Authorizing `identity:get_domain(domain_id=120c61b0a4014edaaeba91fb90655191)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:09.394758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bec23b-0b26-4a2d-924b-a78fa5593ade None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:09.396346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 581/1172] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Jul 6 16:59:09 2022] GET /identity/v3/domains/120c61b0a4014edaaeba91fb90655191 => generated 267 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:09.402169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:09.496709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-072ed1a7-a4eb-43ba-b3bb-307ba1d1c6c3 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:09.516358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:09.529662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1622a72a-74c9-4ac2-8553-cd26dbe042e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:09.530345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a72a-74c9-4ac2-8553-cd26dbe042e4 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:09.530627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a72a-74c9-4ac2-8553-cd26dbe042e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:09.530903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1622a72a-74c9-4ac2-8553-cd26dbe042e4 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:09.531667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622a72a-74c9-4ac2-8553-cd26dbe042e4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:09.533085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1622a72a-74c9-4ac2-8553-cd26dbe042e4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:09.607857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 592/1173] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 16:59:09 2022] POST /identity/v3/projects => generated 361 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 16:59:11.641639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e4eb-ac2f-47a2-a4fb-968433fd0564 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:11.642171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e4eb-ac2f-47a2-a4fb-968433fd0564 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:11.642274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acb1e4eb-ac2f-47a2-a4fb-968433fd0564 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:11.643575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 582/1174] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:11.648642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:11.649035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:11.649207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:11.665510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:11.666778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:11.729661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 593/1175] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:11.754445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e4eb-ac2f-47a2-a4fb-968433fd0564 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:11.850983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acb1e4eb-ac2f-47a2-a4fb-968433fd0564 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:11.883193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed1a5c8d-64ea-4069-9ab7-bbca4ac270f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:11.884028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a5c8d-64ea-4069-9ab7-bbca4ac270f4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:11.884306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a5c8d-64ea-4069-9ab7-bbca4ac270f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:11.884578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed1a5c8d-64ea-4069-9ab7-bbca4ac270f4 None admin] PATH_INFO: `/v3/domains/120c61b0a4014edaaeba91fb90655191` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:11.885726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a5c8d-64ea-4069-9ab7-bbca4ac270f4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=120c61b0a4014edaaeba91fb90655191)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:11.887170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed1a5c8d-64ea-4069-9ab7-bbca4ac270f4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:11.888726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 583/1176] 10.222.0.20 () {56 vars in 1183 bytes} [Wed Jul 6 16:59:11 2022] GET /identity/v3/domains/120c61b0a4014edaaeba91fb90655191 => generated 267 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:11.894209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:11.988448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce666ba-c462-4a88-b267-9270934979bd None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:11.989917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:12.020744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-207a9c66-bedc-4d9a-baca-121903581083 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:12.021390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9c66-bedc-4d9a-baca-121903581083 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:12.021672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9c66-bedc-4d9a-baca-121903581083 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:12.021949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-207a9c66-bedc-4d9a-baca-121903581083 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:12.022681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9c66-bedc-4d9a-baca-121903581083 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:12.024104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-207a9c66-bedc-4d9a-baca-121903581083 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:12.129195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 594/1177] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 16:59:11 2022] POST /identity/v3/users => generated 311 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 16:59:14.157885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a3eb-9693-42e0-aece-5d9405bc4461 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:14.158458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a3eb-9693-42e0-aece-5d9405bc4461 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:14.158458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0646a3eb-9693-42e0-aece-5d9405bc4461 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:14.159869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 584/1178] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:14.165052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:14.165479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:14.165583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:14.182407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:14.183569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:14.246659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 595/1179] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:14.269557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646a3eb-9693-42e0-aece-5d9405bc4461 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:14.329148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:14.369868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0646a3eb-9693-42e0-aece-5d9405bc4461 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:14.402875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:14.403648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:14.403932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:14.404212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:14.414114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:59:14.422190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:59:14.423347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:59:14.424304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 585/1180] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:59:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:59:14.429263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:14.516709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:14.527875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f568bdb-1a76-4cfe-b40f-e4852696c4a9 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:14.562517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:14.563178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:14.563456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:14.563729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:14.564466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:14.564766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:14.566148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:14.574426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 596/1181] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:59:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:14.579728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:14.676866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d8f12bd-9d0b-4ed8-b687-fabfcb16848d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:14.693662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:14.709808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:14.710690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:14.710978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:14.711256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] PATH_INFO: `/v3/users/d3c4740d30b84eb78ee9424669006cf0` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:14.724628 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] RBAC: Authorizing `identity:get_user(user_id=d3c4740d30b84eb78ee9424669006cf0)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:14.726105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:14.727723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 586/1182] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:59:14 2022] GET /identity/v3/users/d3c4740d30b84eb78ee9424669006cf0 => generated 311 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:14.733251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:14.883901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea8477e-0d9d-4c15-9a0c-37897fae2344 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:14.915663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:14.916290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:14.916573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:14.916849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:14.934891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:14.980952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:14.982405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:15.075254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 597/1183] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:59:14 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 342 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:59:15.081105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:15.175598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3eedfda-4d5a-449b-b13d-9849064ce143 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:15.207573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9df33587-77c9-4ce2-9b47-82039378ab09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:15.208612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df33587-77c9-4ce2-9b47-82039378ab09 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:15.208890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df33587-77c9-4ce2-9b47-82039378ab09 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:15.209160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9df33587-77c9-4ce2-9b47-82039378ab09 None admin] PATH_INFO: `/v3/projects/9016843742b449a9a489ae4a57987a3c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:15.210347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df33587-77c9-4ce2-9b47-82039378ab09 None admin] RBAC: Authorizing `identity:get_project(project_id=9016843742b449a9a489ae4a57987a3c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:15.211766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9df33587-77c9-4ce2-9b47-82039378ab09 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:15.213409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 587/1184] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:59:15 2022] GET /identity/v3/projects/9016843742b449a9a489ae4a57987a3c => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:15.220492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:15.268578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:15.316160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9037e3-1de4-4750-a66f-a23fa943e910 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:15.349300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:15.349935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:15.350243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:15.350523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:15.351341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=9016843742b449a9a489ae4a57987a3c, user.id=d3c4740d30b84eb78ee9424669006cf0) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:15.351650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:15.353063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-996c4982-88cd-4dd3-ba12-03167ee4f5ee None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:15.358360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 598/1185] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:59:15 2022] GET /identity/v3/role_assignments?user.id=d3c4740d30b84eb78ee9424669006cf0&scope.project.id=9016843742b449a9a489ae4a57987a3c&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:17.334742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd43a-7c65-451f-a67a-b65bf545209d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:17.335269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd43a-7c65-451f-a67a-b65bf545209d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:17.335403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1cd43a-7c65-451f-a67a-b65bf545209d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:17.336671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 588/1186] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:17.341875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:17.342281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:17.342467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:17.358658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:17.359815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:17.423458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 599/1187] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:17.445573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cd43a-7c65-451f-a67a-b65bf545209d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:17.491288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:17.545053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1cd43a-7c65-451f-a67a-b65bf545209d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:17.579181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:17.579961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:17.580247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:17.580526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:17.590403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:59:17.598010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:59:17.599116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 16:59:17.600405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 589/1188] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:59:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:59:17.605236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:17.649114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:17.700643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9faafc-6ad7-4a2b-bc3e-98ec52db7219 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:17.732416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:17.733059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:17.738739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:17.738739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:17.738739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:17.738739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:17.738739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:17.744262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 600/1189] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:59:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:17.750519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:17.847732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6e37a3a-f1b7-4779-b7be-15a9fb1f831a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:17.849927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:17.880597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:17.881444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:17.881729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:17.882006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] PATH_INFO: `/v3/users/d3c4740d30b84eb78ee9424669006cf0` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:17.883248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] RBAC: Authorizing `identity:get_user(user_id=d3c4740d30b84eb78ee9424669006cf0)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:17.884974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:17.886990 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 590/1190] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:59:17 2022] GET /identity/v3/users/d3c4740d30b84eb78ee9424669006cf0 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:17.892318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:17.988254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44f7ca5-23bd-408f-a26d-08d949868e1d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:17.994728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:18.019788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f0eb4b-9202-4293-8ad7-a0b58d2dedd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:18.020654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0eb4b-9202-4293-8ad7-a0b58d2dedd9 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:18.021145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0eb4b-9202-4293-8ad7-a0b58d2dedd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:18.021643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f0eb4b-9202-4293-8ad7-a0b58d2dedd9 None admin] PATH_INFO: `/v3/projects/9016843742b449a9a489ae4a57987a3c` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:18.023173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0eb4b-9202-4293-8ad7-a0b58d2dedd9 None admin] RBAC: Authorizing `identity:get_project(project_id=9016843742b449a9a489ae4a57987a3c)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:18.024662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f0eb4b-9202-4293-8ad7-a0b58d2dedd9 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:18.026356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 601/1191] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:59:17 2022] GET /identity/v3/projects/9016843742b449a9a489ae4a57987a3c => generated 361 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:18.032479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:18.127307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ed21e5-7990-48a5-a6b0-78db93ed093c None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:18.160326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39c77c28-3807-4069-a809-f1670562c1a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:18.161195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c77c28-3807-4069-a809-f1670562c1a9 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:18.161481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c77c28-3807-4069-a809-f1670562c1a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:18.161762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39c77c28-3807-4069-a809-f1670562c1a9 None admin] PATH_INFO: `/v3/projects/9016843742b449a9a489ae4a57987a3c/users/d3c4740d30b84eb78ee9424669006cf0/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:18.163725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c77c28-3807-4069-a809-f1670562c1a9 None admin] RBAC: Authorizing `identity:create_grant(project_id=9016843742b449a9a489ae4a57987a3c, user_id=d3c4740d30b84eb78ee9424669006cf0, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:18.165141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39c77c28-3807-4069-a809-f1670562c1a9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:18.226311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 591/1192] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 16:59:18 2022] PUT /identity/v3/projects/9016843742b449a9a489ae4a57987a3c/users/d3c4740d30b84eb78ee9424669006cf0/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 16:59:20.194071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c9609-1234-4e83-8e8a-08a2a38dda6f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:20.194595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c9609-1234-4e83-8e8a-08a2a38dda6f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:20.194686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5c9609-1234-4e83-8e8a-08a2a38dda6f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:20.195973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 602/1193] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 16:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 16:59:20.201007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:20.201389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:20.201573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:20.218426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 16:59:20.219592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 16:59:20.243982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:20.285537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 592/1194] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 16:59:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 16:59:20.308912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c9609-1234-4e83-8e8a-08a2a38dda6f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:20.406980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5c9609-1234-4e83-8e8a-08a2a38dda6f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:20.438968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:20.439744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:20.440020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:20.440290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:20.450358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 16:59:20.457813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 16:59:20.458920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 16:59:20.459852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 603/1195] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 16:59:20 2022] GET /identity/v3/roles/admin => generated 83 bytes in 150 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 16:59:20.464800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:20.558478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d7522f-5c52-4d81-9f86-9c7d6a310270 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:20.590613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:20.591265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:20.591544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:20.591816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:20.592550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:20.592877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:20.594259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:20.601900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 593/1196] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 16:59:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:20.607524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:20.641005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:20.703210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4764d0a-138c-481d-8a58-76e4a3ba18c8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:20.735079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:20.736547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:20.736547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:20.736547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] PATH_INFO: `/v3/users/d3c4740d30b84eb78ee9424669006cf0` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:20.737665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] RBAC: Authorizing `identity:get_user(user_id=d3c4740d30b84eb78ee9424669006cf0)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:20.739109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:20.740688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 604/1197] 10.222.0.20 () {56 vars in 1177 bytes} [Wed Jul 6 16:59:20 2022] GET /identity/v3/users/d3c4740d30b84eb78ee9424669006cf0 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:20.746354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:20.771904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:20.843749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4d215c-883a-456b-80b3-5dfd4590e119 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:20.876662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:20.877300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:20.877586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:20.877867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:20.942223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:20.943658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:20.966080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:21.038157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 594/1198] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 16:59:20 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 16:59:21.043888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:21.137682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd3f2b6-8cc4-41c7-b302-25807fb4958c None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:21.139244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:21.170483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99fd4a26-ccd3-4982-ad09-ee1bbc220279 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:21.171931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd4a26-ccd3-4982-ad09-ee1bbc220279 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:21.172214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd4a26-ccd3-4982-ad09-ee1bbc220279 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:21.172485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99fd4a26-ccd3-4982-ad09-ee1bbc220279 None admin] PATH_INFO: `/v3/projects/9016843742b449a9a489ae4a57987a3c` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:21.173635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd4a26-ccd3-4982-ad09-ee1bbc220279 None admin] RBAC: Authorizing `identity:get_project(project_id=9016843742b449a9a489ae4a57987a3c)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:21.175081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99fd4a26-ccd3-4982-ad09-ee1bbc220279 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:21.176712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 605/1199] 10.222.0.20 () {56 vars in 1186 bytes} [Wed Jul 6 16:59:21 2022] GET /identity/v3/projects/9016843742b449a9a489ae4a57987a3c => generated 361 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:21.182470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 16:59:21.279164 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f0cef-f93f-4d9c-bed7-a2ea6839845e None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 16:59:21.301533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:21.311710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 16:59:21.315716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 16:59:21.315716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 16:59:21.315716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 16:59:21.315716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=9016843742b449a9a489ae4a57987a3c, user.id=d3c4740d30b84eb78ee9424669006cf0) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 16:59:21.315716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 16:59:21.315716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf9f53d9-cd18-4002-b030-eee50c16a19d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 16:59:21.321053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 595/1200] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 16:59:21 2022] GET /identity/v3/role_assignments?user.id=d3c4740d30b84eb78ee9424669006cf0&scope.project.id=9016843742b449a9a489ae4a57987a3c&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 16:59:31.167430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=15 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 16:59:31.335604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=6 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:32.770432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243f6b-ba3d-47a0-a24e-5c7469d66b19 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:32.771004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243f6b-ba3d-47a0-a24e-5c7469d66b19 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:32.771004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93243f6b-ba3d-47a0-a24e-5c7469d66b19 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:32.772339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 606/1201] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:32.777494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:32.777922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:32.778075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:32.794459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:32.799730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:32.861205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 596/1202] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:32.886552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93243f6b-ba3d-47a0-a24e-5c7469d66b19 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:32.986433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93243f6b-ba3d-47a0-a24e-5c7469d66b19 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:33.020565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:33.021353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:33.021632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:33.021960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:33.032892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:33.034381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:33.052299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:33.056755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:33.057914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:33.057914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:33.057914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:33.057914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:33.057914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 607/1203] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Jul 06 17:00:33.059600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:33.156491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-793df8c7-108c-4e0c-abb7-a30353d64c62 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:33.184385 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:33.190188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:33.191400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:33.191688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:33.191967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:33.192685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:33.192994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:33.194449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82488fc-81d2-45c0-a5ba-d2d0f40c6e1d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:33.205527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 597/1204] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:33.211325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:33.264343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:33.309554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06ebc541-5307-4b43-baf2-407f74f40b7b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:33.342423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124c09c1-8bbc-4e1f-ad81-5bf3b9c38357 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:33.343084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c09c1-8bbc-4e1f-ad81-5bf3b9c38357 None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:33.343366 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c09c1-8bbc-4e1f-ad81-5bf3b9c38357 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:33.343645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124c09c1-8bbc-4e1f-ad81-5bf3b9c38357 None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:33.344347 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c09c1-8bbc-4e1f-ad81-5bf3b9c38357 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:33.345815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124c09c1-8bbc-4e1f-ad81-5bf3b9c38357 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:33.439569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 608/1205] 10.222.0.20 () {60 vars in 1132 bytes} [Wed Jul 6 17:00:33 2022] POST /identity/v3/users => generated 251 bytes in 229 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:00:35.481556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae8f73-033f-4436-bd99-c06d6f258c45 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:35.482180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae8f73-033f-4436-bd99-c06d6f258c45 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:35.482180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01ae8f73-033f-4436-bd99-c06d6f258c45 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:35.483508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 598/1206] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:35.488999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:35.489425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:35.489534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:35.506959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:35.508105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:35.581381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 609/1207] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:35.604543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae8f73-033f-4436-bd99-c06d6f258c45 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:35.704811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01ae8f73-033f-4436-bd99-c06d6f258c45 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:35.737582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:35.738897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:35.739179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:35.739447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:35.749152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 17:00:35.757123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:35.758292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:35.759349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 599/1208] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 17:00:35 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:35.764287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:35.802956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:35.859231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1655eea7-f22f-4549-b3b8-26b31da50ccb None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:35.892774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:35.893435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:35.893766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:35.894093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:35.894837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:35.895142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:35.896507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:35.904333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 610/1209] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 17:00:35 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:35.910713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:35.960127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:36.008961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c5dad9f-c931-4a58-a277-ca32d4299a75 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:36.042403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:36.043186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:36.043473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:36.043751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:36.054667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:36.056117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:36.072786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:36.076687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:36.077824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:36.077824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:36.077824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:36.077824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:36.077824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 600/1210] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:36.079776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:36.175445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:36.178301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f425dab-a2c8-42d0-ae17-a6ddf09d9c47 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:36.210766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:36.211417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:36.211698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:36.211972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:36.212683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:36.212985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:36.214424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:36.226736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 611/1211] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:36.232371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:36.333964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7ef38c1-91ab-4037-afe3-52c9e5e3b457 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:36.335482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:36.367653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:36.368449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:36.368732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:36.369008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:36.376027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:36.377477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 17:00:36.393382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:36.394902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:36.395870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 601/1212] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:36 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:36.401286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:36.498077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a054a-2277-4bb7-9262-b695984b0552 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:36.532181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:36.532871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:36.533171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:36.533443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:36.534303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:36.534637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:36.536028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:36.552813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 612/1213] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 6 17:00:36 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:36.558575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:36.658180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-401bef1f-1384-4fc4-b131-7f46b6113337 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:36.690516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:36.691661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:36.691946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:36.692224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:36.720997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:36.757201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:36.758674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:36.851293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 602/1214] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 17:00:36 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 17:00:36.857137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:36.875967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:36.956977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2039c674-aee7-45b2-92d5-d31ead56bdcc None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:36.990193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:36.990979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:36.991258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:36.991532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:37.003010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:37.005313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:37.022427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:37.023492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:37.024858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:37.024858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:37.024858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:37.024858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:37.024858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 613/1215] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:37.029318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:37.088668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:37.125422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8db410a-5268-4741-b7fb-7b1914eef0b8 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:37.157608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:37.158286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:37.158573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:37.158853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:37.160095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:37.160403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:37.161755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:37.173206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 603/1216] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:37.179722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:37.247463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:37.276363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-478e0cc3-f2bd-4623-b17f-4cb159f7e875 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:37.310435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:37.311214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:37.311495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:37.311768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:37.318255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:37.319675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 17:00:37.333516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:37.334580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:37.335621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 614/1217] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 17:00:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:37.340710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:37.439469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fe94dc7-dbd4-4bdb-9e2b-c1bfcc78b587 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:37.461664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:37.473179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:37.473836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:37.474159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:37.474441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:37.475227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:37.475536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:37.477001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba8443e-5ba4-4815-98da-8a7a1695101e None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:37.489114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 604/1218] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 17:00:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:37.495153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:37.594798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e85438-b2d7-45d5-ad3c-d77dd2d17d47 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:37.623284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:37.629227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:37.629878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:37.630192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:37.630468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:37.631293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=6aac6f87525e413c8c99e1c6edddf591) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:37.631602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:37.633026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-641e2a07-0600-4a5e-a3d4-7501d81e3174 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:37.638225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 615/1219] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 17:00:37 2022] GET /identity/v3/role_assignments?user.id=6aac6f87525e413c8c99e1c6edddf591&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 259 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:39.614297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c107791-e7f9-4b50-a153-d8ea6ea91b24 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:39.614829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c107791-e7f9-4b50-a153-d8ea6ea91b24 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:39.614919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c107791-e7f9-4b50-a153-d8ea6ea91b24 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:39.616268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 605/1220] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:39.621374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:39.621757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:39.621938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:39.639675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:39.640845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:39.705825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 616/1221] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:39.728375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c107791-e7f9-4b50-a153-d8ea6ea91b24 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:39.829338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c107791-e7f9-4b50-a153-d8ea6ea91b24 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:39.861540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:39.862349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:39.863186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:39.863493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:39.873228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 17:00:39.881757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:39.883015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:39.884105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 606/1222] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 17:00:39 2022] GET /identity/v3/roles/service => generated 85 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:39.889074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:39.984975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14509165-aaa3-462f-ac46-e3d44c205627 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.009131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:40.019552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.020212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.020495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.020773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.021517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] RBAC: Adding query filter params (name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:40.021825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.023230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.030956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 617/1223] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 17:00:39 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:40.036756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:40.080402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:40.134755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f52ca7f-ef3e-45c0-ab9d-ea09d54a5dc2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.166809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.167584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.167971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.168249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.178868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.180314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:40.196640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:40.197664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:40.198993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:40.198993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:40.198993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:40.198993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:40.198993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 607/1224] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:40.205157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:40.303913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4eb27548-305f-45a1-b96b-adf7506130b3 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.336339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.336933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.337221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.337498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.338241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:40.338547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.339905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.351789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 618/1225] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:40.357584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:40.448764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:40.455293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da147d66-dcbe-47e5-aa8f-7c94d9fcb188 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.488233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.489020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.489300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.489575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] PATH_INFO: `/v3/users/placement` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.496253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.497684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 17:00:40.512132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:40.513287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:40.514443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 608/1226] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:40.519032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:40.565684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:40.619114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49deff09-eaa8-46b8-b041-ee540f40f30b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.652619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.653277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.653552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.653823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.654674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:40.654979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.656493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.673679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 619/1227] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:40.679357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:40.775755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e7ac5-7cab-4bac-9044-fefdb26e1d3d None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.808094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.808870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.809150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.809425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.818995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.820433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:40.837601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:40.838624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:40.839874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:40.839874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:40.839874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:40.839874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:40.839874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 609/1228] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:40.844854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:40.943687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07d1aa0c-7146-416e-a9d5-a9239d74096a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:40.945880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:40.976361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:40.977017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:40.977303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:40.977585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:40.978334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:40.978643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:40.980013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:40.990841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 620/1229] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:40.996401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:41.006047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:41.094000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5efe189d-b820-4ee0-8b94-16d269df7e51 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:41.126259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:41.127058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:41.127341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:41.127617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:41.136375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:41.137819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 17:00:41.152636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:41.153559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:41.154882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 610/1230] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 17:00:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:41.159883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:41.263499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3538b181-3243-4f35-aa5c-5f5280f4c751 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:41.298376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:41.299044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:41.299378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:41.299707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:41.301047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:41.301386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:41.302909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-748faaaa-0c90-42ed-9639-9311e2ead9b7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:41.315438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 621/1231] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 17:00:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:41.322109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:41.390994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:41.424762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34df0622-9984-43a3-ada7-dad436e3762b None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:41.456875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86c508f-ffa0-440b-b830-293fc16a1ff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:41.457758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c508f-ffa0-440b-b830-293fc16a1ff1 None admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:41.458060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c508f-ffa0-440b-b830-293fc16a1ff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:41.458361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86c508f-ffa0-440b-b830-293fc16a1ff1 None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/6aac6f87525e413c8c99e1c6edddf591/roles/9d69d0a23f4a4b80b610bb07232d52f6` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:41.473565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c508f-ffa0-440b-b830-293fc16a1ff1 None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=6aac6f87525e413c8c99e1c6edddf591, role_id=9d69d0a23f4a4b80b610bb07232d52f6)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:41.474350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86c508f-ffa0-440b-b830-293fc16a1ff1 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:41.559913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 611/1232] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 17:00:41 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/6aac6f87525e413c8c99e1c6edddf591/roles/9d69d0a23f4a4b80b610bb07232d52f6 => generated 0 bytes in 238 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:00:43.537810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767f93-9e12-4f14-988a-3593c979f2a1 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:43.538406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767f93-9e12-4f14-988a-3593c979f2a1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:43.538406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb767f93-9e12-4f14-988a-3593c979f2a1 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:43.539751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 622/1233] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:43.544738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:43.545118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:43.545287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:43.562163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:43.563343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:43.632955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 612/1234] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:43 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:43.656381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767f93-9e12-4f14-988a-3593c979f2a1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:43.681634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:43.756403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb767f93-9e12-4f14-988a-3593c979f2a1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:43.788952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:43.789673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:43.789956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:43.790272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:43.800713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 17:00:43.808448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:43.809517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:43.810720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 623/1235] 10.222.0.20 () {56 vars in 1102 bytes} [Wed Jul 6 17:00:43 2022] GET /identity/v3/roles/service => generated 85 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:43.816245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:43.860299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:43.913143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6586971a-70e6-4c83-999d-ca59c01afed1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:43.946622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:43.947282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:43.947564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:43.947836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:43.948646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] RBAC: Adding query filter params (name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:43.948947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:43.950335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:43.957937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 613/1236] 10.222.0.20 () {56 vars in 1103 bytes} [Wed Jul 6 17:00:43 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:43.963699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:44.051480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:44.066725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58d2a0b1-a43a-4270-b6af-6dd29f294650 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:44.099341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:44.100120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:44.100404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:44.100680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:44.111642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:44.113746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:44.131792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:44.132849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:44.145416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:44.145416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:44.145416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:44.145416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:44.145416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 624/1237] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:44.145710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:44.236767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2abfb4a-f400-4054-a045-2612cb08d547 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:44.245883 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:44.269500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:44.270173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:44.270455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:44.270728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:44.271435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:44.271735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:44.273089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:44.284946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 614/1238] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:00:44.290607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:44.388079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a48884f9-003f-4e24-93a8-357c2edf1025 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:44.420764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:44.421649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:44.421930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:44.422232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] PATH_INFO: `/v3/users/placement` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:44.424844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:44.430181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:44.431596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 17:00:44.445777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:44.452304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:44.453267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 625/1239] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:44.453913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:44.550386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfdb6a9-79f0-4887-9fbb-c287a21f34a2 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:44.583638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:44.584294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:44.584572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:44.584842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:44.585668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:44.585969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:44.587412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:44.604582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 615/1240] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 6 17:00:44 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:44.610473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:44.708281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9410e22-0dbf-4435-b4da-b81f95f1e9ac None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:44.742655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:44.743294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:44.743579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:44.743853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:44.803540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:44.809908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:44.811373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:44.907150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 626/1241] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 17:00:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 297 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 17:00:44.913017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:44.940043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:45.012365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7105b57-e403-462a-b55a-af1d5b6300bf None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:45.045696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:45.046495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:45.046779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:45.047054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:45.057395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:45.067796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:45.076375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:45.077426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:45.078443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:45.078443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:45.078443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:45.078443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:45.078443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 616/1242] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:45.083306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:45.173451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:45.179542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252f21db-b330-417c-9616-14a8582ec639 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:45.212726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:45.213362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:45.213641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:45.213914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:45.214651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:45.214955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:45.216301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:45.226965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 627/1243] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:45.232765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:45.310531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:45.331425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7093905b-3918-4ec9-9cfb-ee9d4036fc46 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:45.363882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:45.364702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:45.364988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:45.365263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:45.371821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:45.373306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 17:00:45.387678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:45.392302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:45.393442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 617/1244] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 17:00:45 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:45.395325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:45.495783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b8cefb-aef3-43d4-bfe2-e35403fa63a8 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:45.528050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:45.528702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:45.528987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:45.529271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:45.530077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:45.530390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:45.531834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ec35e50-2d5e-4a82-a3c1-1242026db3d6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:45.545754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 628/1245] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 17:00:45 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:45.552450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:45.662369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ae508-5fa8-4981-9b44-4155fdde8ffa None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:45.696377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:45.697024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:45.697307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:45.697584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:45.698440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] RBAC: Adding query filter params (role.id=9d69d0a23f4a4b80b610bb07232d52f6, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=6aac6f87525e413c8c99e1c6edddf591) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:45.703207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:45.703207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2aa4d8-821c-4f88-80e8-dc5323e47e43 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:45.705916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 618/1246] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 17:00:45 2022] GET /identity/v3/role_assignments?user.id=6aac6f87525e413c8c99e1c6edddf591&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=9d69d0a23f4a4b80b610bb07232d52f6 => generated 608 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:47.776104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f524d13-8ac5-40d1-9ff6-ee75a4f311df None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:47.776644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f524d13-8ac5-40d1-9ff6-ee75a4f311df None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:47.776644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f524d13-8ac5-40d1-9ff6-ee75a4f311df None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:47.778058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 629/1247] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:47.783080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:47.783444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:47.783647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:47.789142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:47.801557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:47.802708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:47.867659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 619/1248] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:47.891242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f524d13-8ac5-40d1-9ff6-ee75a4f311df None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:47.908949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:47.993047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f524d13-8ac5-40d1-9ff6-ee75a4f311df None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.026323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.027105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.027392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.027670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:48.038304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 17:00:48.045953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:48.047109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:48.048310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 630/1249] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 17:00:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:48.055023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:48.151383 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7004c5ec-9a0a-4d71-a94d-7b90e545c3f7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.179942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:48.184615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.185281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.185568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.185850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:48.186631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:48.186945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:48.188314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:48.196203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 620/1250] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 17:00:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:48.201898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:48.278311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:48.300269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2daa67fa-b95b-4f24-8205-cea3a690ac83 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.332023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.332791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.333070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.333339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:48.343435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:48.344868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:48.363054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:48.364025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:48.365022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:48.365022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:48.365022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:48.365022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:48.365022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 631/1251] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:48.369970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:48.470630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8eec6cf0-8bfc-49ef-8b6c-a6e57d4f6593 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.502368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.503518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.503798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.504416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:48.505032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:48.505331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:48.506704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:48.517957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 621/1252] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:48.524476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:48.623067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1599fbd6-9fd4-4907-814f-192b3253eff1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.648720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:48.656163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.656951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.657277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.657560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:48.664922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:48.666471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 17:00:48.680470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:48.681666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:48.682731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 632/1253] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:48 2022] GET /identity/v3/users/placement => generated 87 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:48.687610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:48.742471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:48.785455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e6f0b0-1162-48ef-a762-5af8674a8a38 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.818153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.818843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.819126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.819403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:48.820231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:48.820536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:48.821979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:48.838286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 622/1254] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 6 17:00:48 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:48.844001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:48.942830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d89069-a43f-4aca-9ade-1e808f3f59c1 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:48.974779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:48.975411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:48.975690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:48.975964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:49.028745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:49.040682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:49.042196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:49.136421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 633/1255] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 17:00:48 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 17:00:49.142354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:49.240812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4b2605-4bf3-4e09-b7e1-d4f0127063e4 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:49.254751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:49.274847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:49.275633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:49.275919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:49.276195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:49.286394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:49.287830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:49.305184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:49.314083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:49.315189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:49.315189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:49.315189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:49.315189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:49.315189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 623/1256] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:49.315578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:49.397250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:49.408768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968baece-562f-44c3-a7f8-ba482112660b None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:49.443743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:49.444406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:49.444797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:49.445079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:49.445848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:49.446220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:49.447580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:49.458846 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 634/1257] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:49.464623 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:49.561325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9334076b-e78c-48da-b928-701d09cd19be None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:49.595012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:49.595798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:49.596081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:49.596355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:49.603507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:49.604941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 17:00:49.618527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:49.619569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:49.620541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 624/1258] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 17:00:49 2022] GET /identity/v3/projects/service => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:49.625694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:49.728244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c881523-cce2-4a20-94eb-87e968b30953 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:49.761024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:49.761663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:49.761952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:49.762259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:49.763044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:49.763349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:49.764763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c93897a7-7150-417a-8136-5bcbe9cd3400 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:49.776922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 635/1259] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 17:00:49 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:49.783809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:49.808948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:49.882357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae1c6b40-bb64-45bb-abc3-d051eaad3df5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:49.916419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:49.917068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:49.917355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:49.917634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:49.918490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=6aac6f87525e413c8c99e1c6edddf591) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:49.918805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:49.920234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639bb4f0-b79e-4836-b77b-3986fcef9217 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:49.925551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 625/1260] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 17:00:49 2022] GET /identity/v3/role_assignments?user.id=6aac6f87525e413c8c99e1c6edddf591&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 259 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:51.912959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b670e-226e-4b39-9508-820979f1b72f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:51.913506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b670e-226e-4b39-9508-820979f1b72f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:51.913506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f1b670e-226e-4b39-9508-820979f1b72f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:51.914900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 636/1261] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:51.920127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:51.920526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:51.920678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:51.937522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:51.939984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:52.002918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 626/1262] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:51 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:52.026339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b670e-226e-4b39-9508-820979f1b72f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:52.037160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:52.123890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f1b670e-226e-4b39-9508-820979f1b72f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:52.156675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:52.157458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:52.157739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:52.158018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:52.168447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 17:00:52.177781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:52.182722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:52.183789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 637/1263] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:52.185613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:52.203678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:52.281075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6933a98-ee45-4e9c-a5cc-c709f3dea7ed None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:52.314579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:52.315231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:52.315572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:52.315848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:52.316581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:52.316882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:52.318263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:52.326080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 627/1264] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:52.331727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:52.397865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:52.431450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0dabdc-c54d-4791-bb10-b93ca0b55e6f None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:52.463881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:52.464660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:52.464941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:52.465214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:52.476196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:52.477760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:52.495556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:52.496612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:52.497573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:52.497573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:52.497573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:52.497573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:52.497573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 638/1265] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:52.502492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:52.584608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:52.603876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7832004b-8e12-4624-91dc-0781281cf4ae None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:52.636674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:52.637553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:52.638219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:52.638501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:52.639218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:52.639537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:52.640894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:52.652353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 628/1266] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:52.658359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:52.756729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a20c7b2e-3262-4fab-b38d-bc8ddab7be12 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:52.775634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:52.789004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:52.789828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:52.790137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:52.790413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:52.797661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:52.799109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 17:00:52.813511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:52.814616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:52.816265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 639/1267] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:52.820955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:52.917585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e9bc02-709d-4e20-a7a4-9295a847ebad None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:52.949861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:52.950550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:52.950832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:52.951111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:52.951944 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:52.952360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:52.953714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:52.963077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:52.970882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 629/1268] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:52.976989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:53.073853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8357c66d-ce6c-48aa-bc3f-545da8b499e2 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:53.107994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:53.108773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:53.109052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:53.109326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:53.120282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:53.121716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:53.138505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:53.139548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:53.140785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:53.140785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:53.140785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:53.140785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:53.140785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 640/1269] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:53.145393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:53.243282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd3ab28-0bf1-4932-bc38-305f0c6f4388 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:53.276601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:53.277252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:53.277534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:53.277811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:53.278560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:53.278864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:53.280221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:53.291596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 630/1270] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:53.297199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:53.328767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:53.395490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de88f5e-d09f-496a-a23c-58d028aec29a None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:53.428181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:53.428971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:53.429253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:53.429528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:53.436025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:53.437452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 17:00:53.451526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:53.452572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:53.453463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 641/1271] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 17:00:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:53.459089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:53.517388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:53.558412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531645-c22a-4e82-ab06-03dd147596be None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:53.590599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:53.591197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:53.591479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:53.591755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:53.592591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:53.592897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:53.594356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1684aa-5a7b-45ae-b607-74b5b51fd2f4 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:53.606656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 631/1272] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 17:00:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:53.612672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:53.704268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:53.713211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeaba94f-e547-408b-bf40-fc476f9d7c65 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:53.745036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cddc22e0-9c69-43f3-83d9-98c76eec1915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:53.745911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc22e0-9c69-43f3-83d9-98c76eec1915 None admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:53.746219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc22e0-9c69-43f3-83d9-98c76eec1915 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:53.746494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cddc22e0-9c69-43f3-83d9-98c76eec1915 None admin] PATH_INFO: `/v3/projects/aff4b31f45664f0694a878308e3e9114/users/6aac6f87525e413c8c99e1c6edddf591/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:53.748466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc22e0-9c69-43f3-83d9-98c76eec1915 None admin] RBAC: Authorizing `identity:create_grant(project_id=aff4b31f45664f0694a878308e3e9114, user_id=6aac6f87525e413c8c99e1c6edddf591, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:53.749884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cddc22e0-9c69-43f3-83d9-98c76eec1915 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:53.828031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 642/1273] 10.222.0.20 () {58 vars in 1439 bytes} [Wed Jul 6 17:00:53 2022] PUT /identity/v3/projects/aff4b31f45664f0694a878308e3e9114/users/6aac6f87525e413c8c99e1c6edddf591/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:00:55.824974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf7725-600b-4434-a2f1-a9c0c75c4a44 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:55.825482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf7725-600b-4434-a2f1-a9c0c75c4a44 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:55.825576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbaf7725-600b-4434-a2f1-a9c0c75c4a44 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:55.826934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 632/1274] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:00:55.832075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:55.832442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:55.832616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:55.848452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:00:55.849602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:00:55.915676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 643/1275] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:00:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:00:55.939794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf7725-600b-4434-a2f1-a9c0c75c4a44 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.040746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbaf7725-600b-4434-a2f1-a9c0c75c4a44 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:56.058770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:56.075187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:56.075890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:56.076176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:56.076457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:56.086336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(role_id) Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Jul 06 17:00:56.094053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:56.095184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:56.096253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 633/1276] 10.222.0.20 () {56 vars in 1096 bytes} [Wed Jul 6 17:00:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 156 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:56.101735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.181342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:56.199050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d1ef77-dca4-438a-8f35-9d6fb26e02f8 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:56.234188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:56.234846 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:56.235129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:56.235405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:56.236148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:56.236453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:56.238454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:56.246169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 644/1277] 10.222.0.20 () {56 vars in 1099 bytes} [Wed Jul 6 17:00:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:56.251852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.353485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb1ba4a-c711-4abd-a2ce-281e2cf71f8a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:56.385886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:56.386697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:56.386981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:56.387257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:56.398002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:56.399489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:56.416595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:56.417670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:56.418817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:56.418817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:56.418817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:56.418817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:56.418817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 634/1278] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:56.423429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.520045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-911ba5bd-2b41-4dc0-a7f6-bb27999c7ab4 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:56.554908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:56.555641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:56.555921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:56.556192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:56.556904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:56.557203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:56.558593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:56.570128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 645/1279] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:56.575632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.606962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:56.672262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ccdb0f6-ce1c-4dab-948c-0723f82e3559 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:56.704455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:56.705233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:56.705513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:56.705786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:56.713078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:56.714540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_user(user_id) Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Jul 06 17:00:56.728862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:56.729809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:00:56.731093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 635/1280] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:56 2022] GET /identity/v3/users/placement => generated 87 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:56.735701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.739518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:56.833227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ef072e0-e48c-472e-8b88-ce27ff154b82 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:56.865897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:56.866535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:56.866821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:56.867103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:56.867938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:56.868249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:56.869681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:56.887252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 646/1281] 10.222.0.20 () {56 vars in 1143 bytes} [Wed Jul 6 17:00:56 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:56.892897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:56.981117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:56.990474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df4db674-894b-47c2-9b42-79868742f8e0 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:57.023639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:57.024339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:57.024606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:57.024885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:57.090568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:57.092053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:57.177304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:57.187089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 636/1282] 10.222.0.20 () {58 vars in 1282 bytes} [Wed Jul 6 17:00:56 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Jul 06 17:00:57.193474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:57.254446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:57.290408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31a2ebbd-cbdf-406b-a346-4bd5c800e22d None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:57.323117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:57.323891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:57.324192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:57.324442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:57.334017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:57.335474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Jul 06 17:00:57.352531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:57.353624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:57.354788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Jul 06 17:00:57.354788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Jul 06 17:00:57.354788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Jul 06 17:00:57.354788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:57.354788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 647/1283] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:00:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:57.359309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:57.458347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4168a456-2bb7-49ba-94b2-7b693f7719a5 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:57.491773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:57.492419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:57.492697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:57.492967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:57.493676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:57.493977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:57.495367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:57.506409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 637/1284] 10.222.0.20 () {56 vars in 1109 bytes} [Wed Jul 6 17:00:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:57.512289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:57.610409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5fd613-4ee6-494e-8d88-eff2db281be7 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:57.624527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:57.643771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:57.644555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:57.644841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:57.645115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:57.651569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:57.653006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(project_id) Jul 06 17:00:57.667442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application with Lock( Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:00:57.669179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: ERROR keystone.server.flask.application Jul 06 17:00:57.670185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 648/1285] 10.222.0.20 () {56 vars in 1111 bytes} [Wed Jul 6 17:00:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:00:57.674541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:57.724793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:00:57.772642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb17fbd-bdef-4ff6-ae92-a4d297468689 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:57.805637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:57.806358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:57.806644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:57.806933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:57.807711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:57.808051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:57.809567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ddfda2a-f12c-4da2-95b2-67bf6d552eb9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:57.821273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 638/1286] 10.222.0.20 () {56 vars in 1148 bytes} [Wed Jul 6 17:00:57 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:00:57.827274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:00:57.924326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46c7ca5-019d-49a6-9f26-32b4a7aee296 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:00:57.956586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:00:57.957222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:57.957505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:57.957780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:00:57.958638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] RBAC: Adding query filter params (role.id=c9170dee3ed14a2982cd1414c2e9984f, scope.project.id=aff4b31f45664f0694a878308e3e9114, user.id=6aac6f87525e413c8c99e1c6edddf591) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:00:57.958949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:00:57.960363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e69f67-35e8-49eb-8ff5-30714a491b23 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:00:57.966272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 649/1287] 10.222.0.20 () {56 vars in 1374 bytes} [Wed Jul 6 17:00:57 2022] GET /identity/v3/role_assignments?user.id=6aac6f87525e413c8c99e1c6edddf591&scope.project.id=aff4b31f45664f0694a878308e3e9114&role.id=c9170dee3ed14a2982cd1414c2e9984f => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:00:59.998264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f65c4-c94d-4521-adad-9da3e57092c1 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:00:59.998839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f65c4-c94d-4521-adad-9da3e57092c1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:00:59.998839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30f65c4-c94d-4521-adad-9da3e57092c1 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:00.000187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 639/1288] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:00:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:01:00.005820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:00.006272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:00.006398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:00.022601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:01:00.023838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:01:00.053282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:00.092073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 650/1289] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:01:00 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:01:00.116227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f65c4-c94d-4521-adad-9da3e57092c1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:00.226205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30f65c4-c94d-4521-adad-9da3e57092c1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:00.237514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:00.263255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:00.263986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:00.264266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:00.264537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:00.265195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:00.266639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:01:00.279991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:01:00.286243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:00.287349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 640/1290] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 17:01:00 2022] GET /identity/v3/services/placement => generated 90 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:01:00.291080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:00.395030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76186239-148d-48e6-9c81-b364706e6c18 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:00.431565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:00.432221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:00.432508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:00.432807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:00.433491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:01:00.433798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:00.435195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e274c7-bb88-4b0e-85b1-a6c68028d4e6 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:00.440075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 651/1291] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 6 17:01:00 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:01:00.446636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:00.549456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06b0e6e5-ff8f-4291-9c2c-70b1cc418789 None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:00.583819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:00.584484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:00.584770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:00.585050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] PATH_INFO: `/v3/services` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:00.585767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:01:00.586102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:00.587474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0203dd5-6b7a-4dd3-a442-efe4111ccec9 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:00.592079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 641/1292] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 6 17:01:00 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:01:02.583788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea5ed-f38a-4f1b-8ae6-60d0679d6c67 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:02.584263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea5ed-f38a-4f1b-8ae6-60d0679d6c67 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:02.584358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4ea5ed-f38a-4f1b-8ae6-60d0679d6c67 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:02.585708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 652/1293] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:01:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:01:02.590897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d56f8-baa1-4c88-ac40-92ca7961eb39 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:02.591323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d56f8-baa1-4c88-ac40-92ca7961eb39 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:02.591463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a1d56f8-baa1-4c88-ac40-92ca7961eb39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:02.607774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6a1d56f8-baa1-4c88-ac40-92ca7961eb39 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:01:02.608952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6a1d56f8-baa1-4c88-ac40-92ca7961eb39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:01:02.638568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:02.674407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 642/1294] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:01:02 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:01:02.698237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea5ed-f38a-4f1b-8ae6-60d0679d6c67 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:02.728772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:02.796867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4ea5ed-f38a-4f1b-8ae6-60d0679d6c67 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:02.830549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8920c5d-2f7f-490e-914f-5edf6040295d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:02.831210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8920c5d-2f7f-490e-914f-5edf6040295d None admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:02.831488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8920c5d-2f7f-490e-914f-5edf6040295d None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:02.831759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8920c5d-2f7f-490e-914f-5edf6040295d None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:02.832490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8920c5d-2f7f-490e-914f-5edf6040295d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:02.833838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8920c5d-2f7f-490e-914f-5edf6040295d None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:02.893798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 653/1295] 10.222.0.20 () {60 vars in 1141 bytes} [Wed Jul 6 17:01:02 2022] POST /identity/v3/services => generated 246 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:01:04.918867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757700-bc25-4555-9733-2392faf99d13 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:04.919400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757700-bc25-4555-9733-2392faf99d13 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:04.919531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad757700-bc25-4555-9733-2392faf99d13 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:04.920821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 643/1296] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:01:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:01:04.926617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:04.927356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:04.927356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:04.943569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:01:04.944738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:01:05.015714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 654/1297] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:01:04 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:01:05.038956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757700-bc25-4555-9733-2392faf99d13 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:05.136793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad757700-bc25-4555-9733-2392faf99d13 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:05.170611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:05.171337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:05.171617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:05.171892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] PATH_INFO: `/v3/services/placement` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:05.172649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:05.174020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:01:05.186163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:01:05.187309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:05.188179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 644/1298] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 17:01:05 2022] GET /identity/v3/services/placement => generated 90 bytes in 149 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:01:05.193297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:05.211000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:05.289713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0fb02b-a9e4-454f-b4dd-97074811b1ae None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:05.323481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:05.324133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:05.324422 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:05.324702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:05.325406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:01:05.325713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:05.327103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:05.332195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 655/1299] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 6 17:01:05 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:01:05.337970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:05.369483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:05.434449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7110ac4c-ac0a-4e7a-bae9-a13a5124796a None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:05.466869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:05.467514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:05.467795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:05.468068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:05.468845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] RBAC: Adding query filter params (interface=public, service_id=2c4478b0d13942deb597fe806f77788e, region_id=RegionOne) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:01:05.469152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:05.470557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4cbf1ba-c8ae-40d8-8604-54fad71f5aa3 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:05.475472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 645/1300] 10.222.0.20 () {56 vars in 1251 bytes} [Wed Jul 6 17:01:05 2022] GET /identity/v3/endpoints?service_id=2c4478b0d13942deb597fe806f77788e&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:01:05.480857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:05.560180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:05.578197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0665f60-d7ea-4546-915d-ecafc4e44a80 None admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:05.610215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c16617a-5be4-41ff-94d8-a2a0351e12e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:05.610861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16617a-5be4-41ff-94d8-a2a0351e12e3 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:05.611138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16617a-5be4-41ff-94d8-a2a0351e12e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:05.611416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c16617a-5be4-41ff-94d8-a2a0351e12e3 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:05.612622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16617a-5be4-41ff-94d8-a2a0351e12e3 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:05.613973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c16617a-5be4-41ff-94d8-a2a0351e12e3 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:05.620645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 656/1301] 10.222.0.20 () {56 vars in 1087 bytes} [Wed Jul 6 17:01:05 2022] GET /identity/v3/services => generated 2191 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:01:07.635058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74a3c-2bbf-42c0-b4ae-97e0f9b42571 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:07.635602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74a3c-2bbf-42c0-b4ae-97e0f9b42571 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:07.635602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39d74a3c-2bbf-42c0-b4ae-97e0f9b42571 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:07.637028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 646/1302] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:01:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 17:01:07.642113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:07.642548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:07.642684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:07.659005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:01:07.660183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:01:07.725371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 657/1303] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:01:07 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Jul 06 17:01:07.756098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74a3c-2bbf-42c0-b4ae-97e0f9b42571 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:07.853955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:07.860386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39d74a3c-2bbf-42c0-b4ae-97e0f9b42571 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:07.893925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:07.894744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:07.895028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:07.895305 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] PATH_INFO: `/v3/services/placement` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:07.895957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:07.897321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Traceback (most recent call last): Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application rv = self.dispatch_request() Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request Jul 06 17:01:07.908844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._get_service(service_id) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Jul 06 17:01:07.910378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.get_or_create( Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application with Lock( Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self._enter() Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application return self.creator() Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application created_value = creator( Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: ERROR keystone.server.flask.application Jul 06 17:01:07.911344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 647/1304] 10.222.0.20 () {56 vars in 1117 bytes} [Wed Jul 6 17:01:07 2022] GET /identity/v3/services/placement => generated 90 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Jul 06 17:01:07.916503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:07.990990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:08.012763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789fe78a-48f1-444e-b218-9896e263f97e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:08.045142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:08.045795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:08.046107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:08.046387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] PATH_INFO: `/v3/services` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:08.047087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:01:08.047392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:08.048750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d2815c1-dd5d-4186-b20d-91efae3ff300 None admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:08.054976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 658/1305] 10.222.0.20 () {56 vars in 1116 bytes} [Wed Jul 6 17:01:07 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:01:08.060216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:01:08.157681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53deb6ee-a0e6-4a02-94c3-4c919af8edbc None admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:01:08.190625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31711d0a-1453-41e6-9e5a-f59194a87b16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:01:08.191272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31711d0a-1453-41e6-9e5a-f59194a87b16 None admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:01:08.191559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31711d0a-1453-41e6-9e5a-f59194a87b16 None admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:01:08.191840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31711d0a-1453-41e6-9e5a-f59194a87b16 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:01:08.192571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31711d0a-1453-41e6-9e5a-f59194a87b16 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:01:08.193966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31711d0a-1453-41e6-9e5a-f59194a87b16 None admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:01:08.274479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 648/1306] 10.222.0.20 () {60 vars in 1144 bytes} [Wed Jul 6 17:01:08 2022] POST /identity/v3/endpoints => generated 331 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:01:18.055321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=30 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:01:18.269845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:18.314957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75be1a-8617-4955-98a9-9c08446bce49 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:18.316143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75be1a-8617-4955-98a9-9c08446bce49 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:18.316832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f75be1a-8617-4955-98a9-9c08446bce49 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:18.319471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 659/1307] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:18.325564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4451fa-13a5-478d-8e33-20ea54226968 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:18.325909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4451fa-13a5-478d-8e33-20ea54226968 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:18.326239 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c4451fa-13a5-478d-8e33-20ea54226968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:18.450018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7c4451fa-13a5-478d-8e33-20ea54226968 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:18.451694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7c4451fa-13a5-478d-8e33-20ea54226968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:18.578075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 649/1308] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 249 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:18.628886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1086-4a4c-48ae-a6db-d8d48f27d300 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:18.629174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1086-4a4c-48ae-a6db-d8d48f27d300 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:18.629653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79b1086-4a4c-48ae-a6db-d8d48f27d300 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:18.631044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 660/1309] 10.222.0.20 () {54 vars in 964 bytes} [Wed Jul 6 17:07:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:18.637800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f7ba-4d1f-4598-a8c4-baa6f208f5bc None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:18.638120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f7ba-4d1f-4598-a8c4-baa6f208f5bc None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:18.638406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9047f7ba-4d1f-4598-a8c4-baa6f208f5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:18.722217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9047f7ba-4d1f-4598-a8c4-baa6f208f5bc None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:18.723665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9047f7ba-4d1f-4598-a8c4-baa6f208f5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:18.751107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:18.809648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 650/1310] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Jul 6 17:07:18 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:18.819726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1086-4a4c-48ae-a6db-d8d48f27d300 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:18.821644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c79b1086-4a4c-48ae-a6db-d8d48f27d300 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:18.940153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79b1086-4a4c-48ae-a6db-d8d48f27d300 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:19.016567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:19.017291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:19.017701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:19.018112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:19.019877 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:19.075422 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:19.131784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:19.133401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e5e591-e6e8-4a86-b737-e1463ee484a5 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:19.152944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 661/1311] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:21.494925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9497-4d5d-43de-bd6d-cae267786500 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:21.495451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9497-4d5d-43de-bd6d-cae267786500 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:21.495451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80bd9497-4d5d-43de-bd6d-cae267786500 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:21.496930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 651/1312] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:21.502586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d577-1a5e-42eb-9589-78ba558556bd None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:21.503012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d577-1a5e-42eb-9589-78ba558556bd None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:21.503228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f13d577-1a5e-42eb-9589-78ba558556bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:21.589892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9f13d577-1a5e-42eb-9589-78ba558556bd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:21.591142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9f13d577-1a5e-42eb-9589-78ba558556bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:21.696321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 662/1313] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:21.734961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9497-4d5d-43de-bd6d-cae267786500 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:21.736707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-80bd9497-4d5d-43de-bd6d-cae267786500 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:21.858436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80bd9497-4d5d-43de-bd6d-cae267786500 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:21.942800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:21.945925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:21.946653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:21.946974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:21.947190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:21.954671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:22.075192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:22.076651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1337b901-aa47-4f4b-9a93-e8f0417cc429 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:22.095806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 652/1314] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:24.691286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add416e-bdbd-4501-b0e8-22d776e91c8e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:24.691841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add416e-bdbd-4501-b0e8-22d776e91c8e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:24.691841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add416e-bdbd-4501-b0e8-22d776e91c8e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:24.693193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 663/1315] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:24.698772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5213-ad60-4699-94dd-ac919ae2ce22 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:24.699143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5213-ad60-4699-94dd-ac919ae2ce22 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:24.699332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33b5213-ad60-4699-94dd-ac919ae2ce22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:24.762354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c33b5213-ad60-4699-94dd-ac919ae2ce22 None None] MFA Rules not processed for user `7d464cf1e672441c9fee71e315390413`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:24.763548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c33b5213-ad60-4699-94dd-ac919ae2ce22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:24.813447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:24.857566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 653/1316] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:24 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:24.896429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add416e-bdbd-4501-b0e8-22d776e91c8e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:24.897967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5add416e-bdbd-4501-b0e8-22d776e91c8e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:24.908076 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:24.999429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add416e-bdbd-4501-b0e8-22d776e91c8e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:25.069882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:25.070557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:25.070840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:25.071116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:25.073325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:25.132560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:25.177971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:25.179430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13fe62da-a63a-4d27-8faf-051909e68e63 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:25.197381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 664/1317] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:24 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:28.143682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed6b2-07d8-4653-b5f6-a5be559f58e6 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:28.144317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed6b2-07d8-4653-b5f6-a5be559f58e6 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:28.144317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a4ed6b2-07d8-4653-b5f6-a5be559f58e6 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:28.145619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 654/1318] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:28.151339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8088f-e417-48d4-8d04-9e117658d4eb None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:28.151768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8088f-e417-48d4-8d04-9e117658d4eb None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:28.151900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a8088f-e417-48d4-8d04-9e117658d4eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:28.213794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-21a8088f-e417-48d4-8d04-9e117658d4eb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:28.215013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-21a8088f-e417-48d4-8d04-9e117658d4eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:28.308473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 665/1319] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:28 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:28.346629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ed6b2-07d8-4653-b5f6-a5be559f58e6 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:28.348199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2a4ed6b2-07d8-4653-b5f6-a5be559f58e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:28.450176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a4ed6b2-07d8-4653-b5f6-a5be559f58e6 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:28.520824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:28.521457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:28.521736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:28.522008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:28.523700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:28.530980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:28.631381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:28.632825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8de66fdf-c43b-4a82-9895-fdb1cdf969f6 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:28.652238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 655/1320] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:28 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:31.636995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39690-8e71-41d6-a149-b654402eb891 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:31.637542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39690-8e71-41d6-a149-b654402eb891 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:31.637542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89d39690-8e71-41d6-a149-b654402eb891 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:31.638950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 666/1321] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:31.644094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66883-2d6c-436b-abd4-dba4d687864e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:31.644496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66883-2d6c-436b-abd4-dba4d687864e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:31.644762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c66883-2d6c-436b-abd4-dba4d687864e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:31.708078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-24c66883-2d6c-436b-abd4-dba4d687864e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:31.709263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-24c66883-2d6c-436b-abd4-dba4d687864e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:31.767892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:31.807754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 656/1322] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:31.843544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39690-8e71-41d6-a149-b654402eb891 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:31.845144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-89d39690-8e71-41d6-a149-b654402eb891 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:31.866278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:31.958725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89d39690-8e71-41d6-a149-b654402eb891 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:32.035586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:32.036222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:32.036505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:32.036783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:32.038492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:32.109967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:32.148370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:32.149798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34b1973d-0c08-408d-b80c-357dfdb894c7 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:32.167981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 667/1323] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 325 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:34.234816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc743-2ccd-4427-90a2-936099202cc0 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:34.235358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc743-2ccd-4427-90a2-936099202cc0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:34.235461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafcc743-2ccd-4427-90a2-936099202cc0 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:34.236792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 657/1324] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:34.242206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6664-fb2b-416f-81f6-9cd3145b0ba9 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:34.242646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6664-fb2b-416f-81f6-9cd3145b0ba9 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:34.242765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70dd6664-fb2b-416f-81f6-9cd3145b0ba9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:34.307002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-70dd6664-fb2b-416f-81f6-9cd3145b0ba9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:34.308114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-70dd6664-fb2b-416f-81f6-9cd3145b0ba9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:34.404331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 668/1325] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:34.440023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc743-2ccd-4427-90a2-936099202cc0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:34.441590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cafcc743-2ccd-4427-90a2-936099202cc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:34.545543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafcc743-2ccd-4427-90a2-936099202cc0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:34.620893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:34.621534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:34.621811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:34.622115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:34.623998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:34.640978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:34.736801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:34.738564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e818ee0d-b515-4c76-9e7c-930f02e7537e service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:34.757192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 658/1326] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:34 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 318 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:36.832921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100eb6-ffcf-4590-8096-1a5a35d3e9a5 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:36.833458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100eb6-ffcf-4590-8096-1a5a35d3e9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:36.833458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3100eb6-ffcf-4590-8096-1a5a35d3e9a5 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:36.834883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 669/1327] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:36.840664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaa298-4e2c-42dd-8cdc-6d65550e6e2b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:36.841101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaa298-4e2c-42dd-8cdc-6d65550e6e2b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:36.841295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aeaa298-4e2c-42dd-8cdc-6d65550e6e2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:36.905686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5aeaa298-4e2c-42dd-8cdc-6d65550e6e2b None None] MFA Rules not processed for user `7d464cf1e672441c9fee71e315390413`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:36.906920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5aeaa298-4e2c-42dd-8cdc-6d65550e6e2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:36.971462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:37.005125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 659/1328] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:36 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:37.042163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100eb6-ffcf-4590-8096-1a5a35d3e9a5 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:37.043742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d3100eb6-ffcf-4590-8096-1a5a35d3e9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:37.077951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:37.154264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3100eb6-ffcf-4590-8096-1a5a35d3e9a5 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:37.229912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:37.230599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:37.230882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:37.231161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:37.232806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:37.312111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:37.344193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:37.345634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdb75470-a936-43c9-b825-f0a4fcf0f2d5 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:37.363979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 670/1329] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:37 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 322 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:39.845541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60bea3-bbab-4282-93ef-438f63dec738 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:39.846101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60bea3-bbab-4282-93ef-438f63dec738 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:39.846202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa60bea3-bbab-4282-93ef-438f63dec738 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:39.847510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 660/1330] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:39.852599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4615a-c6ac-422d-9a82-35d032dcfba2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:39.853028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4615a-c6ac-422d-9a82-35d032dcfba2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:39.853207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4615a-c6ac-422d-9a82-35d032dcfba2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:39.916146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e1c4615a-c6ac-422d-9a82-35d032dcfba2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:39.917338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e1c4615a-c6ac-422d-9a82-35d032dcfba2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:40.011400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 671/1331] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:40.046265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60bea3-bbab-4282-93ef-438f63dec738 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:40.047804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fa60bea3-bbab-4282-93ef-438f63dec738 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:40.149854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa60bea3-bbab-4282-93ef-438f63dec738 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:40.220396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:40.221033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:40.221312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:40.221585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:40.223614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:40.250350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:40.333116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:40.334629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67467bb-c7fc-449a-b7da-c570fe082ecb service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:40.353045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 661/1332] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 307 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:42.416683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443719b-8c0c-45e3-b919-5e7d68f51949 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:42.417209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443719b-8c0c-45e3-b919-5e7d68f51949 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:42.417324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3443719b-8c0c-45e3-b919-5e7d68f51949 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:42.418658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 672/1333] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:42.423812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562a08-3bdf-45d6-a908-309883db468a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:42.424194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562a08-3bdf-45d6-a908-309883db468a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:42.424367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67562a08-3bdf-45d6-a908-309883db468a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:42.487201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-67562a08-3bdf-45d6-a908-309883db468a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:42.488390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-67562a08-3bdf-45d6-a908-309883db468a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:42.563508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:42.585554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 662/1334] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:42.640678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54946f3-1d38-41fd-a791-36e736ff21c0 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:42.640967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54946f3-1d38-41fd-a791-36e736ff21c0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:42.641246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54946f3-1d38-41fd-a791-36e736ff21c0 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:42.642662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 673/1335] 10.222.0.20 () {54 vars in 964 bytes} [Wed Jul 6 17:07:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:42.648332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63a59-9222-48fc-9100-0d9b7afc2203 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:42.648624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63a59-9222-48fc-9100-0d9b7afc2203 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:42.648906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76b63a59-9222-48fc-9100-0d9b7afc2203 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:42.721831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-76b63a59-9222-48fc-9100-0d9b7afc2203 None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:42.723085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-76b63a59-9222-48fc-9100-0d9b7afc2203 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:42.798827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 663/1336] 10.222.0.20 () {58 vars in 1061 bytes} [Wed Jul 6 17:07:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:42.809368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54946f3-1d38-41fd-a791-36e736ff21c0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:42.810931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b54946f3-1d38-41fd-a791-36e736ff21c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:42.852210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:42.917134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54946f3-1d38-41fd-a791-36e736ff21c0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:42.989480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:42.990278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:42.990561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:42.990835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:42.992470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:43.076009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:43.103932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:43.105395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8470ba9-59ba-439a-a0fe-c0fabe99caf4 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:43.125478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 674/1337] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:07:46.194115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150eb4-ef5f-4ada-8493-932ac7870faf None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:46.194649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150eb4-ef5f-4ada-8493-932ac7870faf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:46.194757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff150eb4-ef5f-4ada-8493-932ac7870faf None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:46.196059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 664/1338] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:46.201869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b725-2b71-4983-b375-9628c90482ff None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:46.202288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b725-2b71-4983-b375-9628c90482ff None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:46.202469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa3b725-2b71-4983-b375-9628c90482ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:46.266364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-dfa3b725-2b71-4983-b375-9628c90482ff None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:46.267597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-dfa3b725-2b71-4983-b375-9628c90482ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:46.360614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 675/1339] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:46 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:46.397055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150eb4-ef5f-4ada-8493-932ac7870faf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:46.398626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ff150eb4-ef5f-4ada-8493-932ac7870faf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:46.471530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:46.499404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff150eb4-ef5f-4ada-8493-932ac7870faf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:46.573804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:46.574483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:46.574770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:46.575046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:46.576689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:46.684112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:46.685553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-174d9823-165d-4c44-8766-5bf149712449 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:46.705286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 665/1340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:46 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:50.855258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c243-314c-4ef5-ac6c-708da3632460 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:50.855769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c243-314c-4ef5-ac6c-708da3632460 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:50.855865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8436c243-314c-4ef5-ac6c-708da3632460 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:50.857559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 676/1341] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:50.862933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0bb1-fc4a-4eae-bb9d-173c35ea1464 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:50.863350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0bb1-fc4a-4eae-bb9d-173c35ea1464 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:50.863499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985e0bb1-fc4a-4eae-bb9d-173c35ea1464 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:50.870594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:50.940391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-985e0bb1-fc4a-4eae-bb9d-173c35ea1464 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:50.941618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-985e0bb1-fc4a-4eae-bb9d-173c35ea1464 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:51.064567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 666/1342] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:51.104003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c243-314c-4ef5-ac6c-708da3632460 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:51.106184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8436c243-314c-4ef5-ac6c-708da3632460 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:51.155595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:07:51.199363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8436c243-314c-4ef5-ac6c-708da3632460 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:51.203495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67e5a5c4-0d8f-4fb2-bd45-9b0b8b6f7f5c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:51.204153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a5c4-0d8f-4fb2-bd45-9b0b8b6f7f5c service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:51.204433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a5c4-0d8f-4fb2-bd45-9b0b8b6f7f5c service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:51.204705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67e5a5c4-0d8f-4fb2-bd45-9b0b8b6f7f5c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:51.214231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5a5c4-0d8f-4fb2-bd45-9b0b8b6f7f5c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:51.215654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67e5a5c4-0d8f-4fb2-bd45-9b0b8b6f7f5c service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:51.225057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 677/1343] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 122 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:54.194008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809fcb-4805-4291-9f11-8a3fa420c06d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:54.194595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809fcb-4805-4291-9f11-8a3fa420c06d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:54.194728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce809fcb-4805-4291-9f11-8a3fa420c06d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:54.196194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 667/1344] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:54.202531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267355b-8320-42cb-a06a-a0f9d9a5a44b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:54.203020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267355b-8320-42cb-a06a-a0f9d9a5a44b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:54.203112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a267355b-8320-42cb-a06a-a0f9d9a5a44b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:54.233929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a267355b-8320-42cb-a06a-a0f9d9a5a44b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:54.235027 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a267355b-8320-42cb-a06a-a0f9d9a5a44b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:54.319799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 678/1345] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:54 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:54.354999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809fcb-4805-4291-9f11-8a3fa420c06d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:54.356714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ce809fcb-4805-4291-9f11-8a3fa420c06d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:54.370047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce809fcb-4805-4291-9f11-8a3fa420c06d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:54.373819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eda9f751-ac4c-42ee-a8d4-7e870b5581f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:54.374487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9f751-ac4c-42ee-a8d4-7e870b5581f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:54.374771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9f751-ac4c-42ee-a8d4-7e870b5581f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:54.375051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda9f751-ac4c-42ee-a8d4-7e870b5581f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:54.384186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9f751-ac4c-42ee-a8d4-7e870b5581f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:54.386143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eda9f751-ac4c-42ee-a8d4-7e870b5581f1 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:54.395600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 668/1346] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:54 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:07:58.918312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e71fd-107b-41d4-97c7-011904be3d6c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:58.918824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e71fd-107b-41d4-97c7-011904be3d6c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:58.918914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-240e71fd-107b-41d4-97c7-011904be3d6c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:58.920222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 679/1347] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:07:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:07:58.927673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2120-9249-492e-96b6-4e0282bb81a7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:58.928534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2120-9249-492e-96b6-4e0282bb81a7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:58.928995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66c2120-9249-492e-96b6-4e0282bb81a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:58.947576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b66c2120-9249-492e-96b6-4e0282bb81a7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:07:58.948762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b66c2120-9249-492e-96b6-4e0282bb81a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:07:58.956629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 669/1348] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:07:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:07:58.995227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e71fd-107b-41d4-97c7-011904be3d6c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:07:59.006539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-240e71fd-107b-41d4-97c7-011904be3d6c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:07:59.010192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0296a400-3e60-4ea8-a347-d962305ac23b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:07:59.010932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a400-3e60-4ea8-a347-d962305ac23b service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:07:59.011215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a400-3e60-4ea8-a347-d962305ac23b service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:07:59.011491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0296a400-3e60-4ea8-a347-d962305ac23b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:07:59.021646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a400-3e60-4ea8-a347-d962305ac23b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:07:59.023775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0296a400-3e60-4ea8-a347-d962305ac23b service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:07:59.037899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 680/1349] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:07:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:03.927413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52679-2929-4af4-bac9-3023f6651e2e None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:03.928299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52679-2929-4af4-bac9-3023f6651e2e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:03.928786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85b52679-2929-4af4-bac9-3023f6651e2e None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:03.930397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 670/1350] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:08:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:03.935974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133150e5-4b54-4b78-8470-a3159f1ba69a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:03.936885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133150e5-4b54-4b78-8470-a3159f1ba69a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:03.937960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-133150e5-4b54-4b78-8470-a3159f1ba69a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:04.095090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-133150e5-4b54-4b78-8470-a3159f1ba69a None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:04.097156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-133150e5-4b54-4b78-8470-a3159f1ba69a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:04.129182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:08:04.185083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 681/1351] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:08:03 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:08.170774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460520-c7bb-4a9c-9bc8-0cf9f428a390 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:08.171459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460520-c7bb-4a9c-9bc8-0cf9f428a390 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:08.171459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c460520-c7bb-4a9c-9bc8-0cf9f428a390 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:08.172693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 671/1352] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:08:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:08.178476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641762f7-ea83-4940-9963-d668d937948a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:08.178901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641762f7-ea83-4940-9963-d668d937948a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:08.179015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-641762f7-ea83-4940-9963-d668d937948a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:08.217744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-641762f7-ea83-4940-9963-d668d937948a None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:08.219030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-641762f7-ea83-4940-9963-d668d937948a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:08.228826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 682/1353] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:08:08 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:08:08.942824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=72 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:08:09.871936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafc666-9ca1-41d2-a1e5-5aa3e1fe6f25 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:09.872844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafc666-9ca1-41d2-a1e5-5aa3e1fe6f25 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:09.872844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fafc666-9ca1-41d2-a1e5-5aa3e1fe6f25 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:09.874341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 672/1354] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:09.879414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f4bfd-91a1-4536-bc0d-50e2b861f9a5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:09.879809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f4bfd-91a1-4536-bc0d-50e2b861f9a5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:09.879971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-604f4bfd-91a1-4536-bc0d-50e2b861f9a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:09.898577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-604f4bfd-91a1-4536-bc0d-50e2b861f9a5 None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:09.900413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-604f4bfd-91a1-4536-bc0d-50e2b861f9a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:09.908974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 683/1355] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:08:09 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:08:13.432125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfc9f4-185f-47d4-88da-fc86416ba1be None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:13.432644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfc9f4-185f-47d4-88da-fc86416ba1be None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:13.432644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eecfc9f4-185f-47d4-88da-fc86416ba1be None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:13.434404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 673/1356] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:13.439626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0cd14-5511-43fc-a1c2-b05c4ced99f7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:13.440047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0cd14-5511-43fc-a1c2-b05c4ced99f7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:13.440182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0cd14-5511-43fc-a1c2-b05c4ced99f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:13.458732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6ae0cd14-5511-43fc-a1c2-b05c4ced99f7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:13.460152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6ae0cd14-5511-43fc-a1c2-b05c4ced99f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:13.469355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 684/1357] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:08:13.526975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fdadc-f10c-465e-95cb-d3583f50b066 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:13.527549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fdadc-f10c-465e-95cb-d3583f50b066 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:13.528148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6fdadc-f10c-465e-95cb-d3583f50b066 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:13.530247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 674/1358] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 6 17:08:13 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:13.539776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97562023-6bc5-4a6c-873e-c13d4938e3b0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:13.541088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97562023-6bc5-4a6c-873e-c13d4938e3b0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:13.549419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97562023-6bc5-4a6c-873e-c13d4938e3b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:13.600875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-97562023-6bc5-4a6c-873e-c13d4938e3b0 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:13.602109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-97562023-6bc5-4a6c-873e-c13d4938e3b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:13.694734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 685/1359] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 6 17:08:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:08:13.702444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fdadc-f10c-465e-95cb-d3583f50b066 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:13.717778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6fdadc-f10c-465e-95cb-d3583f50b066 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:13.724404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dbbf67-935a-473e-8693-2dc3342d62ad service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:13.725128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbbf67-935a-473e-8693-2dc3342d62ad service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:13.725480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbbf67-935a-473e-8693-2dc3342d62ad service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:13.725845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dbbf67-935a-473e-8693-2dc3342d62ad service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:13.736175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbbf67-935a-473e-8693-2dc3342d62ad service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:13.737846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18dbbf67-935a-473e-8693-2dc3342d62ad service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:13.749689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 675/1360] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:15.973080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b971f-d104-43dd-8179-e73ec4fc9c6d None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:15.973628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b971f-d104-43dd-8179-e73ec4fc9c6d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:15.973886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb8b971f-d104-43dd-8179-e73ec4fc9c6d None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:15.975385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 686/1361] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:15.981078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323186-c8ae-49ad-9184-1e1ad724fb7c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:15.981876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323186-c8ae-49ad-9184-1e1ad724fb7c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:15.982197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c323186-c8ae-49ad-9184-1e1ad724fb7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:16.000721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6c323186-c8ae-49ad-9184-1e1ad724fb7c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:16.001932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6c323186-c8ae-49ad-9184-1e1ad724fb7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:16.010677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 676/1362] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:16.054789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b971f-d104-43dd-8179-e73ec4fc9c6d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:16.072058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb8b971f-d104-43dd-8179-e73ec4fc9c6d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:16.078603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a2edf1-a83f-4d95-9a56-1a8d84fecb90 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:16.079328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2edf1-a83f-4d95-9a56-1a8d84fecb90 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:16.079681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2edf1-a83f-4d95-9a56-1a8d84fecb90 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:16.080030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a2edf1-a83f-4d95-9a56-1a8d84fecb90 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:16.089363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2edf1-a83f-4d95-9a56-1a8d84fecb90 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:16.091084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a2edf1-a83f-4d95-9a56-1a8d84fecb90 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:16.103334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 687/1363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:18.623341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f9f0-5bf5-41f9-91e4-dcfd437cc6dc None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:18.623847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f9f0-5bf5-41f9-91e4-dcfd437cc6dc None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:18.623941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb6f9f0-5bf5-41f9-91e4-dcfd437cc6dc None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:18.625276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 677/1364] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:18.630709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383e5e3-7b44-4501-b62b-71b48f746e6a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:18.631123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383e5e3-7b44-4501-b62b-71b48f746e6a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:18.631346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0383e5e3-7b44-4501-b62b-71b48f746e6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:18.650085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-0383e5e3-7b44-4501-b62b-71b48f746e6a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:18.651278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0383e5e3-7b44-4501-b62b-71b48f746e6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:18.659003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 688/1365] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:18.704441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2416-3589-453e-bdbc-85620172446e None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:18.704804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2416-3589-453e-bdbc-85620172446e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:18.705004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fd2416-3589-453e-bdbc-85620172446e None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:18.706399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 678/1366] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 6 17:08:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:18.712596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d85da-fe90-4e34-b2f9-9f36f6f759e3 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:18.718993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d85da-fe90-4e34-b2f9-9f36f6f759e3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:18.718993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d85da-fe90-4e34-b2f9-9f36f6f759e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:18.737288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-593d85da-fe90-4e34-b2f9-9f36f6f759e3 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:18.738630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-593d85da-fe90-4e34-b2f9-9f36f6f759e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:18.748118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 689/1367] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 6 17:08:18 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:18.755821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2416-3589-453e-bdbc-85620172446e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:18.770338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fd2416-3589-453e-bdbc-85620172446e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:18.776631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfd839bd-0db1-4152-b459-45d76a51fbd2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:18.777257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd839bd-0db1-4152-b459-45d76a51fbd2 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:18.777540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd839bd-0db1-4152-b459-45d76a51fbd2 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:18.777818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfd839bd-0db1-4152-b459-45d76a51fbd2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:18.786484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd839bd-0db1-4152-b459-45d76a51fbd2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:18.788083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfd839bd-0db1-4152-b459-45d76a51fbd2 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:18.797983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 679/1368] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:21.085671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50799dd7-d825-44a2-9481-a99b0b773825 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.086249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50799dd7-d825-44a2-9481-a99b0b773825 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.086249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50799dd7-d825-44a2-9481-a99b0b773825 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.088392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 690/1369] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:21.093327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed51-88c9-4b19-b1be-6ab9a165d1b3 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.094158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed51-88c9-4b19-b1be-6ab9a165d1b3 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.094597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b97ed51-88c9-4b19-b1be-6ab9a165d1b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.113705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5b97ed51-88c9-4b19-b1be-6ab9a165d1b3 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:21.114945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5b97ed51-88c9-4b19-b1be-6ab9a165d1b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:21.123771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 680/1370] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:21.168812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50799dd7-d825-44a2-9481-a99b0b773825 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:21.183945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50799dd7-d825-44a2-9481-a99b0b773825 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:21.189627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d548b9de-b386-4079-9382-5c282e934247 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:21.190332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b9de-b386-4079-9382-5c282e934247 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.190624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b9de-b386-4079-9382-5c282e934247 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.191025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d548b9de-b386-4079-9382-5c282e934247 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.200649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548b9de-b386-4079-9382-5c282e934247 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:21.202397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d548b9de-b386-4079-9382-5c282e934247 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:21.213125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 691/1371] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:21.441247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e535-ae0c-4ff7-9ff8-8f35ca1cee40 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.441536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e535-ae0c-4ff7-9ff8-8f35ca1cee40 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.442106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4492e535-ae0c-4ff7-9ff8-8f35ca1cee40 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.443720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 681/1372] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:21 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:21.450340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23f6b0-e8de-4e58-adb4-15ac0574fcbc None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.450931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23f6b0-e8de-4e58-adb4-15ac0574fcbc None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.451401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e23f6b0-e8de-4e58-adb4-15ac0574fcbc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.470308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8e23f6b0-e8de-4e58-adb4-15ac0574fcbc None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:21.471883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8e23f6b0-e8de-4e58-adb4-15ac0574fcbc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:21.480935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 692/1373] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:21.829878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080f8-f39c-4023-ad60-c119b5e080ef None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.829878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080f8-f39c-4023-ad60-c119b5e080ef None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.829878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f1080f8-f39c-4023-ad60-c119b5e080ef None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.830973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 682/1374] 10.222.0.20 () {54 vars in 963 bytes} [Wed Jul 6 17:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:21.836148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d236f38-a635-44cc-8f9d-507f57c32ea0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.836438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d236f38-a635-44cc-8f9d-507f57c32ea0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.836715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d236f38-a635-44cc-8f9d-507f57c32ea0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.844314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:08:21.887920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9d236f38-a635-44cc-8f9d-507f57c32ea0 None None] MFA Rules not processed for user `ba635abc81fd47c6b680836c67eeeeea`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:21.889125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9d236f38-a635-44cc-8f9d-507f57c32ea0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:21.951753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 693/1375] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Jul 6 17:08:21 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:21.959125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1080f8-f39c-4023-ad60-c119b5e080ef None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:21.969824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f1080f8-f39c-4023-ad60-c119b5e080ef None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:21.973411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-361d2558-d45a-438e-bc50-f206de072e1c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:21.974080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2558-d45a-438e-bc50-f206de072e1c service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:21.974385 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2558-d45a-438e-bc50-f206de072e1c service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:21.974648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-361d2558-d45a-438e-bc50-f206de072e1c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:21.984898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2558-d45a-438e-bc50-f206de072e1c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:21.986618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-361d2558-d45a-438e-bc50-f206de072e1c service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:21.997853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 683/1376] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:23.366719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dc898-33e3-4347-9663-2172147e5d9f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:23.367289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dc898-33e3-4347-9663-2172147e5d9f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:23.367289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169dc898-33e3-4347-9663-2172147e5d9f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:23.369206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 694/1377] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:23.374753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93e15-e422-44dc-9f16-431a93e453d5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:23.375186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93e15-e422-44dc-9f16-431a93e453d5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:23.375444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf93e15-e422-44dc-9f16-431a93e453d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:23.394085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2bf93e15-e422-44dc-9f16-431a93e453d5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:23.395296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2bf93e15-e422-44dc-9f16-431a93e453d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:23.403118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 684/1378] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:23.446877 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dc898-33e3-4347-9663-2172147e5d9f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:23.460793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169dc898-33e3-4347-9663-2172147e5d9f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:23.466241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4b4667-75d3-4589-9c46-f9853192c9b4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:23.466882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4667-75d3-4589-9c46-f9853192c9b4 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:23.467165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4667-75d3-4589-9c46-f9853192c9b4 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:23.467444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4b4667-75d3-4589-9c46-f9853192c9b4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:23.475590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4667-75d3-4589-9c46-f9853192c9b4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:23.477164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4b4667-75d3-4589-9c46-f9853192c9b4 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:23.487138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 695/1379] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:25.726744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd9ba-273e-4161-bf1e-cccc2c78a6bf None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:25.727292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd9ba-273e-4161-bf1e-cccc2c78a6bf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:25.727552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b39cd9ba-273e-4161-bf1e-cccc2c78a6bf None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:25.729155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 685/1380] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:25.734400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cde3-e3ef-4803-94aa-92ec668c3c67 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:25.734801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cde3-e3ef-4803-94aa-92ec668c3c67 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:25.734965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fe9cde3-e3ef-4803-94aa-92ec668c3c67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:25.754307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9fe9cde3-e3ef-4803-94aa-92ec668c3c67 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:25.755434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9fe9cde3-e3ef-4803-94aa-92ec668c3c67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:25.764155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 696/1381] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:25.811389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd9ba-273e-4161-bf1e-cccc2c78a6bf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:25.828146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b39cd9ba-273e-4161-bf1e-cccc2c78a6bf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:25.833788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9970ff51-67ae-4b4e-b98f-6b984f3a8c8e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:25.834601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ff51-67ae-4b4e-b98f-6b984f3a8c8e service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:25.834984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ff51-67ae-4b4e-b98f-6b984f3a8c8e service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:25.835363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9970ff51-67ae-4b4e-b98f-6b984f3a8c8e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:25.844402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970ff51-67ae-4b4e-b98f-6b984f3a8c8e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:25.845980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9970ff51-67ae-4b4e-b98f-6b984f3a8c8e service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:25.856026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 686/1382] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:28.006105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be960f-58a0-4a6a-989f-e83f7fb39231 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:28.006572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be960f-58a0-4a6a-989f-e83f7fb39231 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:28.006692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24be960f-58a0-4a6a-989f-e83f7fb39231 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:28.008062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 697/1383] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 17:08:28.013119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed701e-6e30-48e6-9b16-e74edecd83b2 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:28.013539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed701e-6e30-48e6-9b16-e74edecd83b2 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:28.017509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ed701e-6e30-48e6-9b16-e74edecd83b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:28.032247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-60ed701e-6e30-48e6-9b16-e74edecd83b2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:28.033444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-60ed701e-6e30-48e6-9b16-e74edecd83b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:28.041914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 687/1384] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:28.082208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be960f-58a0-4a6a-989f-e83f7fb39231 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:28.096649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24be960f-58a0-4a6a-989f-e83f7fb39231 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:28.101935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f27caab-a4bd-45cd-a54a-75ccc28ef10f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:28.103848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27caab-a4bd-45cd-a54a-75ccc28ef10f service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:28.104132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27caab-a4bd-45cd-a54a-75ccc28ef10f service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:28.104410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f27caab-a4bd-45cd-a54a-75ccc28ef10f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:28.113594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27caab-a4bd-45cd-a54a-75ccc28ef10f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:28.115192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f27caab-a4bd-45cd-a54a-75ccc28ef10f service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:28.125612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 698/1385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:30.295024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3eafa-d48e-4051-a0e6-002b5e3d804c None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:30.295555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3eafa-d48e-4051-a0e6-002b5e3d804c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:30.295706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de3eafa-d48e-4051-a0e6-002b5e3d804c None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:30.297689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 688/1386] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:30.303808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9967c3-635c-41a4-a368-5b79c26663da None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:30.304360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9967c3-635c-41a4-a368-5b79c26663da None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:30.304360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9967c3-635c-41a4-a368-5b79c26663da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:30.321884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-cb9967c3-635c-41a4-a368-5b79c26663da None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:30.323099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cb9967c3-635c-41a4-a368-5b79c26663da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:30.330966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 699/1387] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:30.375516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3eafa-d48e-4051-a0e6-002b5e3d804c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:30.393089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de3eafa-d48e-4051-a0e6-002b5e3d804c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:30.400442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68b73f2-58f3-4960-96e3-741c8ebcddb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:30.401220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b73f2-58f3-4960-96e3-741c8ebcddb4 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:30.401576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b73f2-58f3-4960-96e3-741c8ebcddb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:30.401932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68b73f2-58f3-4960-96e3-741c8ebcddb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:30.411935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b73f2-58f3-4960-96e3-741c8ebcddb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:30.413514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68b73f2-58f3-4960-96e3-741c8ebcddb4 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:30.423691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 689/1388] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:32.619209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e134b7-2c3a-458d-aa10-6047e4c0730e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:32.619759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e134b7-2c3a-458d-aa10-6047e4c0730e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:32.619867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57e134b7-2c3a-458d-aa10-6047e4c0730e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:32.621147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 700/1389] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:32.626552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567d53-dc7f-445b-93f9-2d13c623df45 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:32.626965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567d53-dc7f-445b-93f9-2d13c623df45 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:32.627120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07567d53-dc7f-445b-93f9-2d13c623df45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:32.645166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-07567d53-dc7f-445b-93f9-2d13c623df45 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:32.646406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-07567d53-dc7f-445b-93f9-2d13c623df45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:32.655681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 690/1390] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:32.700053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e134b7-2c3a-458d-aa10-6047e4c0730e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:32.718743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57e134b7-2c3a-458d-aa10-6047e4c0730e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:32.731362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a241aa1f-db12-485e-9c8e-7af50976a609 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:32.732239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241aa1f-db12-485e-9c8e-7af50976a609 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:32.732593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241aa1f-db12-485e-9c8e-7af50976a609 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:32.732954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a241aa1f-db12-485e-9c8e-7af50976a609 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:32.744842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241aa1f-db12-485e-9c8e-7af50976a609 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:32.747062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a241aa1f-db12-485e-9c8e-7af50976a609 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:32.758668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 701/1391] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:35.033779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddfd11-3931-45ef-8b6f-79ad7e2a5e63 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:35.034335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddfd11-3931-45ef-8b6f-79ad7e2a5e63 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:35.034335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ddfd11-3931-45ef-8b6f-79ad7e2a5e63 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:35.035703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 691/1392] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:35.041493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023c296-e8db-4d08-a349-322740f29225 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:35.042092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023c296-e8db-4d08-a349-322740f29225 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:35.042092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d023c296-e8db-4d08-a349-322740f29225 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:35.059699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d023c296-e8db-4d08-a349-322740f29225 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:35.060910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d023c296-e8db-4d08-a349-322740f29225 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:35.068703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 702/1393] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:35.112829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddfd11-3931-45ef-8b6f-79ad7e2a5e63 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:35.127977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ddfd11-3931-45ef-8b6f-79ad7e2a5e63 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:35.133858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9ede394-9012-42ea-b15f-cdb8fe8c765e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:35.134525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ede394-9012-42ea-b15f-cdb8fe8c765e service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:35.134809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ede394-9012-42ea-b15f-cdb8fe8c765e service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:35.135089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9ede394-9012-42ea-b15f-cdb8fe8c765e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:35.143371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ede394-9012-42ea-b15f-cdb8fe8c765e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:35.144955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9ede394-9012-42ea-b15f-cdb8fe8c765e service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:35.155334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 692/1394] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:37.326001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026317-51ed-434a-8a6f-7c0c90cb18fe None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.326586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026317-51ed-434a-8a6f-7c0c90cb18fe None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.326586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9026317-51ed-434a-8a6f-7c0c90cb18fe None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.327989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 703/1395] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:37.333171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aadd1-23e8-4460-ab4e-8eb70e989982 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.333622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aadd1-23e8-4460-ab4e-8eb70e989982 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.333738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f3aadd1-23e8-4460-ab4e-8eb70e989982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.349343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef44df-1ead-4ecf-adbc-6efb95dc612c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.349633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef44df-1ead-4ecf-adbc-6efb95dc612c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.349914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fef44df-1ead-4ecf-adbc-6efb95dc612c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.351277 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 704/1396] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 17:08:37.351949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3f3aadd1-23e8-4460-ab4e-8eb70e989982 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:37.353758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3f3aadd1-23e8-4460-ab4e-8eb70e989982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:37.356686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffb0d9-3dab-4538-aaae-31e0bc80b8f4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.356981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffb0d9-3dab-4538-aaae-31e0bc80b8f4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.357262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98ffb0d9-3dab-4538-aaae-31e0bc80b8f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.361711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 693/1397] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:37.375279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-98ffb0d9-3dab-4538-aaae-31e0bc80b8f4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:37.376475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-98ffb0d9-3dab-4538-aaae-31e0bc80b8f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:37.384905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 705/1398] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:08:37.417844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ae28-35be-4d42-93ee-5851e00f2be5 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.418014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ae28-35be-4d42-93ee-5851e00f2be5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.418333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c568ae28-35be-4d42-93ee-5851e00f2be5 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.419817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 694/1399] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 6 17:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:37.424803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b389ad-1c56-4ecd-aab6-a98b5c37148c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.425091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b389ad-1c56-4ecd-aab6-a98b5c37148c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.425368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b389ad-1c56-4ecd-aab6-a98b5c37148c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.429154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568ae28-35be-4d42-93ee-5851e00f2be5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:37.444063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c568ae28-35be-4d42-93ee-5851e00f2be5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:37.449859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:37.450541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.450825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.451100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.459151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:37.460724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:37.469931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 695/1400] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:08:37.473450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-65b389ad-1c56-4ecd-aab6-a98b5c37148c None None] MFA Rules not processed for user `62d81f5f899b4113a6a54f0712725656`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:37.474764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-65b389ad-1c56-4ecd-aab6-a98b5c37148c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:37.519611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:08:37.535744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 706/1401] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 6 17:08:37 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:37.543343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:37.552623 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24ddab6-aadb-45c7-b7f4-dcda1187274f service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:37.556339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7df89ec-37bc-4829-bf30-448b4856e56b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:37.556995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df89ec-37bc-4829-bf30-448b4856e56b service glance] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:37.557272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df89ec-37bc-4829-bf30-448b4856e56b service glance] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:37.557543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7df89ec-37bc-4829-bf30-448b4856e56b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:37.566859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df89ec-37bc-4829-bf30-448b4856e56b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:37.568387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7df89ec-37bc-4829-bf30-448b4856e56b service glance] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:37.578532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 696/1402] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:38.452848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783d5d6-c8bf-46cc-8b72-36b8d12ba03f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:38.453283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783d5d6-c8bf-46cc-8b72-36b8d12ba03f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:38.453527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f783d5d6-c8bf-46cc-8b72-36b8d12ba03f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:38.501384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-f783d5d6-c8bf-46cc-8b72-36b8d12ba03f None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:38.502618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f783d5d6-c8bf-46cc-8b72-36b8d12ba03f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:38.569386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 707/1403] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:08:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:38.613842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4926-ae46-4e93-98bf-c41a12c2d576 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:38.614307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4926-ae46-4e93-98bf-c41a12c2d576 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:38.614453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc7d4926-ae46-4e93-98bf-c41a12c2d576 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:38.615821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 697/1404] 10.222.0.20 () {54 vars in 942 bytes} [Wed Jul 6 17:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:38.622682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02817263-0704-4676-b64c-9f94c86b45a3 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:38.622972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02817263-0704-4676-b64c-9f94c86b45a3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:38.623248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02817263-0704-4676-b64c-9f94c86b45a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:38.670306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-02817263-0704-4676-b64c-9f94c86b45a3 None None] MFA Rules not processed for user `0d90c264ccd44a6e88ac202f4e6a4fde`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:38.671488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-02817263-0704-4676-b64c-9f94c86b45a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:38.741471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 708/1405] 10.222.0.20 () {58 vars in 1039 bytes} [Wed Jul 6 17:08:38 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:38.751304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4926-ae46-4e93-98bf-c41a12c2d576 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:38.765234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc7d4926-ae46-4e93-98bf-c41a12c2d576 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:38.770439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0e32726-207d-4ef0-9c44-e85ae69cd084 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:38.770959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32726-207d-4ef0-9c44-e85ae69cd084 service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:38.771256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32726-207d-4ef0-9c44-e85ae69cd084 service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:38.771529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e32726-207d-4ef0-9c44-e85ae69cd084 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:38.780917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e32726-207d-4ef0-9c44-e85ae69cd084 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:38.782706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0e32726-207d-4ef0-9c44-e85ae69cd084 service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:38.791204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 698/1406] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:08:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:08:39.699135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdcb16-867d-4a72-9a1e-880cc3cec899 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:39.699784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdcb16-867d-4a72-9a1e-880cc3cec899 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:39.699784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbdcb16-867d-4a72-9a1e-880cc3cec899 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:39.701228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 709/1407] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:08:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:08:39.706358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cb96-907d-41b8-a8d6-f24a5f20331f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:39.707186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cb96-907d-41b8-a8d6-f24a5f20331f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:39.707697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dac7cb96-907d-41b8-a8d6-f24a5f20331f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:39.714069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=73 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:08:39.727484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-dac7cb96-907d-41b8-a8d6-f24a5f20331f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:08:39.728995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-dac7cb96-907d-41b8-a8d6-f24a5f20331f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:08:39.737125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 699/1408] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:08:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:08:39.783008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdcb16-867d-4a72-9a1e-880cc3cec899 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:08:39.798695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbdcb16-867d-4a72-9a1e-880cc3cec899 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:08:39.804388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9c7cf1-48b8-4bb4-8acd-313d137e9a0d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:08:39.804965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7cf1-48b8-4bb4-8acd-313d137e9a0d service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:08:39.805840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7cf1-48b8-4bb4-8acd-313d137e9a0d service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:08:39.806160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9c7cf1-48b8-4bb4-8acd-313d137e9a0d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:08:39.814694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c7cf1-48b8-4bb4-8acd-313d137e9a0d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:08:39.816306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9c7cf1-48b8-4bb4-8acd-313d137e9a0d service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:08:39.842434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 710/1409] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:08:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:08:49.826647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:08:49.950097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:09:02.188049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ad58-7747-4389-a66c-23444bc53f65 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:02.188709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ad58-7747-4389-a66c-23444bc53f65 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:02.188709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b72ad58-7747-4389-a66c-23444bc53f65 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:02.189983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 700/1410] 10.222.0.20 () {54 vars in 918 bytes} [Wed Jul 6 17:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:02.195099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889261-6be8-49a1-a177-cbfb090b3002 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:02.195491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889261-6be8-49a1-a177-cbfb090b3002 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:02.195657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d889261-6be8-49a1-a177-cbfb090b3002 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:02.213126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2d889261-6be8-49a1-a177-cbfb090b3002 None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:02.214383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2d889261-6be8-49a1-a177-cbfb090b3002 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:02.222858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 711/1411] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Jul 6 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:02.236924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5e89a-398d-48f7-b64a-32d26ecdcdaa None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:02.237215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5e89a-398d-48f7-b64a-32d26ecdcdaa None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:02.237496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf5e89a-398d-48f7-b64a-32d26ecdcdaa None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:02.238865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 701/1412] 10.222.0.20 () {54 vars in 918 bytes} [Wed Jul 6 17:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:02.243345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379a48-673e-466a-ac2a-dabb0a53918f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:02.243633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379a48-673e-466a-ac2a-dabb0a53918f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:02.243911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6379a48-673e-466a-ac2a-dabb0a53918f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:02.261907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a6379a48-673e-466a-ac2a-dabb0a53918f None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:02.263098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a6379a48-673e-466a-ac2a-dabb0a53918f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:02.272049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 712/1413] 10.222.0.20 () {58 vars in 1015 bytes} [Wed Jul 6 17:09:02 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:04.741648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757bdd-241c-44a7-abd3-a5532779f9ad None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:04.742232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757bdd-241c-44a7-abd3-a5532779f9ad None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:04.742232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf757bdd-241c-44a7-abd3-a5532779f9ad None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:04.743601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 702/1414] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:04.749251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2012-54c7-46cf-bfc7-7d9df31b0aed None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:04.750357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2012-54c7-46cf-bfc7-7d9df31b0aed None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:04.750357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89b2012-54c7-46cf-bfc7-7d9df31b0aed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:04.767040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a89b2012-54c7-46cf-bfc7-7d9df31b0aed None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:04.768223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a89b2012-54c7-46cf-bfc7-7d9df31b0aed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:04.775891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 713/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:04.819573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf757bdd-241c-44a7-abd3-a5532779f9ad None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:04.833553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf757bdd-241c-44a7-abd3-a5532779f9ad None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:04.838987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913952f3-5d23-4ff5-b584-40fe77ec587c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:04.840153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913952f3-5d23-4ff5-b584-40fe77ec587c service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:04.840435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913952f3-5d23-4ff5-b584-40fe77ec587c service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:04.840712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913952f3-5d23-4ff5-b584-40fe77ec587c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:04.848824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913952f3-5d23-4ff5-b584-40fe77ec587c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:04.850481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913952f3-5d23-4ff5-b584-40fe77ec587c service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:04.860478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 703/1416] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:09:05.759958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d6a3-a201-446c-a9a7-6aa36b35991e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:05.760490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d6a3-a201-446c-a9a7-6aa36b35991e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:05.760490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b777d6a3-a201-446c-a9a7-6aa36b35991e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:05.762492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 714/1417] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:05.767372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739b52b-e8cf-4366-8a4f-065c0cd4e32a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:05.767798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739b52b-e8cf-4366-8a4f-065c0cd4e32a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:05.767906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739b52b-e8cf-4366-8a4f-065c0cd4e32a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:05.785435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e739b52b-e8cf-4366-8a4f-065c0cd4e32a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:05.786646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e739b52b-e8cf-4366-8a4f-065c0cd4e32a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:05.794832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 704/1418] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:05.945120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d6a3-a201-446c-a9a7-6aa36b35991e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:05.958913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b777d6a3-a201-446c-a9a7-6aa36b35991e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:05.964181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca70348-6ddd-4b3f-b729-79e9f94d4b6f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:05.967394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca70348-6ddd-4b3f-b729-79e9f94d4b6f service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:05.967394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca70348-6ddd-4b3f-b729-79e9f94d4b6f service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:05.967394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca70348-6ddd-4b3f-b729-79e9f94d4b6f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:05.973162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca70348-6ddd-4b3f-b729-79e9f94d4b6f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:05.974803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca70348-6ddd-4b3f-b729-79e9f94d4b6f service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:05.984701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 715/1419] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:06.864101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6a6b9-06e4-4f0f-8597-ae5bdcbc83e1 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:06.864668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6a6b9-06e4-4f0f-8597-ae5bdcbc83e1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:06.864668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33c6a6b9-06e4-4f0f-8597-ae5bdcbc83e1 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:06.866062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 705/1420] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:06.871408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c814-d8ef-4710-ab95-b6a52c38f14a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:06.872096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c814-d8ef-4710-ab95-b6a52c38f14a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:06.872252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec98c814-d8ef-4710-ab95-b6a52c38f14a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:06.890018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ec98c814-d8ef-4710-ab95-b6a52c38f14a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:06.891241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ec98c814-d8ef-4710-ab95-b6a52c38f14a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:06.898947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 716/1421] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:07.048561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6a6b9-06e4-4f0f-8597-ae5bdcbc83e1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:07.062673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33c6a6b9-06e4-4f0f-8597-ae5bdcbc83e1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:07.070964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3936d16-44b5-4ec3-8a17-8e7aa765b458 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:07.070964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936d16-44b5-4ec3-8a17-8e7aa765b458 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:07.070964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936d16-44b5-4ec3-8a17-8e7aa765b458 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:07.070964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3936d16-44b5-4ec3-8a17-8e7aa765b458 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:07.077787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3936d16-44b5-4ec3-8a17-8e7aa765b458 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:07.079450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3936d16-44b5-4ec3-8a17-8e7aa765b458 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:07.088854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 706/1422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:07.942755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10c9a-7552-484a-8567-53cc3279baab None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:07.943323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10c9a-7552-484a-8567-53cc3279baab None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:07.943323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41e10c9a-7552-484a-8567-53cc3279baab None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:07.944707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 717/1423] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:07.949499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c658c-6080-44b8-af4e-9ce18166436e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:07.949897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c658c-6080-44b8-af4e-9ce18166436e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:07.950097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad9c658c-6080-44b8-af4e-9ce18166436e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:07.968165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ad9c658c-6080-44b8-af4e-9ce18166436e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:07.969358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ad9c658c-6080-44b8-af4e-9ce18166436e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:07.977172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 707/1424] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:08.128620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10c9a-7552-484a-8567-53cc3279baab None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:08.143100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41e10c9a-7552-484a-8567-53cc3279baab None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:08.148398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d504e6-8745-41a7-b81f-4189988b8939 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:08.149026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d504e6-8745-41a7-b81f-4189988b8939 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:08.149308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d504e6-8745-41a7-b81f-4189988b8939 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:08.149583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d504e6-8745-41a7-b81f-4189988b8939 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:08.158545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d504e6-8745-41a7-b81f-4189988b8939 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:08.160111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d504e6-8745-41a7-b81f-4189988b8939 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:08.169430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 718/1425] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:09.018831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf09f41-6254-4f89-a37a-8ea136554b35 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:09.019415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf09f41-6254-4f89-a37a-8ea136554b35 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:09.019415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf09f41-6254-4f89-a37a-8ea136554b35 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:09.020771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 708/1426] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:09.025847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c0f3-bedf-4fb7-bd7e-e76dc558054e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:09.026311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c0f3-bedf-4fb7-bd7e-e76dc558054e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:09.026443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed4c0f3-bedf-4fb7-bd7e-e76dc558054e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:09.044423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4ed4c0f3-bedf-4fb7-bd7e-e76dc558054e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:09.045615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4ed4c0f3-bedf-4fb7-bd7e-e76dc558054e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:09.053352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 719/1427] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:09.201714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf09f41-6254-4f89-a37a-8ea136554b35 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:09.216677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf09f41-6254-4f89-a37a-8ea136554b35 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:09.222051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-864318d3-7beb-458f-b04e-fee324b53143 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:09.222697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864318d3-7beb-458f-b04e-fee324b53143 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:09.222982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864318d3-7beb-458f-b04e-fee324b53143 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:09.223262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-864318d3-7beb-458f-b04e-fee324b53143 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:09.231940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864318d3-7beb-458f-b04e-fee324b53143 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:09.233518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-864318d3-7beb-458f-b04e-fee324b53143 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:09.243107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 709/1428] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:10.121332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64b15-120f-4353-95b4-7077f3aac4df None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:10.122276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64b15-120f-4353-95b4-7077f3aac4df None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:10.122276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64b15-120f-4353-95b4-7077f3aac4df None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:10.123556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 720/1429] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:10.128512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7475a9-88ce-4754-ac75-a3ab4f2cd151 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:10.128957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7475a9-88ce-4754-ac75-a3ab4f2cd151 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:10.129072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd7475a9-88ce-4754-ac75-a3ab4f2cd151 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:10.147690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-fd7475a9-88ce-4754-ac75-a3ab4f2cd151 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:10.148872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fd7475a9-88ce-4754-ac75-a3ab4f2cd151 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:10.156540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 710/1430] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:10.307553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64b15-120f-4353-95b4-7077f3aac4df None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:10.321910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64b15-120f-4353-95b4-7077f3aac4df None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:10.327869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5d7c5b6-351b-4dc6-9112-7279d8326d4b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:10.328505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c5b6-351b-4dc6-9112-7279d8326d4b service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:10.328790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c5b6-351b-4dc6-9112-7279d8326d4b service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:10.329067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5d7c5b6-351b-4dc6-9112-7279d8326d4b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:10.337174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c5b6-351b-4dc6-9112-7279d8326d4b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:10.338792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5d7c5b6-351b-4dc6-9112-7279d8326d4b service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:10.348724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 721/1431] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:11.230747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d221b-a1c9-4491-aaa6-707635c81368 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:11.231333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d221b-a1c9-4491-aaa6-707635c81368 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:11.231333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d7d221b-a1c9-4491-aaa6-707635c81368 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:11.232659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 711/1432] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:11.237409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59048-8f1a-4ad7-9be6-9c90701a4f4f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:11.237784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59048-8f1a-4ad7-9be6-9c90701a4f4f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:11.237964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38e59048-8f1a-4ad7-9be6-9c90701a4f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:11.256502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-38e59048-8f1a-4ad7-9be6-9c90701a4f4f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:11.257702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-38e59048-8f1a-4ad7-9be6-9c90701a4f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:11.265476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 722/1433] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:11.415054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d221b-a1c9-4491-aaa6-707635c81368 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:11.429706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d7d221b-a1c9-4491-aaa6-707635c81368 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:11.434960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c95c8d-14bb-47a1-ae13-994238bbfcc2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:11.435581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c95c8d-14bb-47a1-ae13-994238bbfcc2 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:11.435861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c95c8d-14bb-47a1-ae13-994238bbfcc2 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:11.436132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c95c8d-14bb-47a1-ae13-994238bbfcc2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:11.444116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c95c8d-14bb-47a1-ae13-994238bbfcc2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:11.445752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c95c8d-14bb-47a1-ae13-994238bbfcc2 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:11.455259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 712/1434] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:12.324089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bcd73-03af-4ed4-80ff-276917026085 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:12.324513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bcd73-03af-4ed4-80ff-276917026085 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:12.324660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-715bcd73-03af-4ed4-80ff-276917026085 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:12.326053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 723/1435] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:12.330942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752180-caf8-4ded-a3f5-a40c873d3f25 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:12.331368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752180-caf8-4ded-a3f5-a40c873d3f25 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:12.331501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2752180-caf8-4ded-a3f5-a40c873d3f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:12.348889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d2752180-caf8-4ded-a3f5-a40c873d3f25 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:12.350136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d2752180-caf8-4ded-a3f5-a40c873d3f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:12.357979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 713/1436] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:12.508419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bcd73-03af-4ed4-80ff-276917026085 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:12.522505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-715bcd73-03af-4ed4-80ff-276917026085 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:12.528425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322b40e3-0d28-45f4-8ef1-d615d5f1e876 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:12.529097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b40e3-0d28-45f4-8ef1-d615d5f1e876 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:12.529375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b40e3-0d28-45f4-8ef1-d615d5f1e876 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:12.529645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322b40e3-0d28-45f4-8ef1-d615d5f1e876 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:12.537884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b40e3-0d28-45f4-8ef1-d615d5f1e876 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:12.539520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-322b40e3-0d28-45f4-8ef1-d615d5f1e876 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:12.549653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 724/1437] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:13.384745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d25eff-833d-42a0-806b-87e149be3287 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:13.385309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d25eff-833d-42a0-806b-87e149be3287 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:13.385309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17d25eff-833d-42a0-806b-87e149be3287 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:13.386773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 714/1438] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:09:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:13.391507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a808f0-6006-4581-ab20-a6d5962a3d1b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:13.391906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a808f0-6006-4581-ab20-a6d5962a3d1b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:13.392071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5a808f0-6006-4581-ab20-a6d5962a3d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:13.409529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c5a808f0-6006-4581-ab20-a6d5962a3d1b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:13.410748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c5a808f0-6006-4581-ab20-a6d5962a3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:13.418932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 725/1439] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:09:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:13.567763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d25eff-833d-42a0-806b-87e149be3287 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:13.581907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17d25eff-833d-42a0-806b-87e149be3287 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:13.587277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9824fefd-ac71-41ca-9d79-81d659c74912 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:13.587910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824fefd-ac71-41ca-9d79-81d659c74912 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:13.588198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824fefd-ac71-41ca-9d79-81d659c74912 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:13.588497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9824fefd-ac71-41ca-9d79-81d659c74912 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:13.596465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824fefd-ac71-41ca-9d79-81d659c74912 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:13.598095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9824fefd-ac71-41ca-9d79-81d659c74912 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:13.607898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 715/1440] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:15.529142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40a6f4-ec4e-469b-8638-0f57f3fd742b None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:15.529687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40a6f4-ec4e-469b-8638-0f57f3fd742b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:15.529687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc40a6f4-ec4e-469b-8638-0f57f3fd742b None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:15.531183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 726/1441] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:15.536775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f11d7-9364-4688-8362-f6dfb2da9758 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:15.537235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f11d7-9364-4688-8362-f6dfb2da9758 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:15.537344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d2f11d7-9364-4688-8362-f6dfb2da9758 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:15.555713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4d2f11d7-9364-4688-8362-f6dfb2da9758 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:15.556904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4d2f11d7-9364-4688-8362-f6dfb2da9758 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:15.564741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 716/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:15.603555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40a6f4-ec4e-469b-8638-0f57f3fd742b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:15.613982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc40a6f4-ec4e-469b-8638-0f57f3fd742b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:15.617434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b66e928c-50ae-4ff9-9a46-8ed38fb9ac48 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:15.618148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e928c-50ae-4ff9-9a46-8ed38fb9ac48 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:15.618378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e928c-50ae-4ff9-9a46-8ed38fb9ac48 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:15.618649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b66e928c-50ae-4ff9-9a46-8ed38fb9ac48 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:15.627922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e928c-50ae-4ff9-9a46-8ed38fb9ac48 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:15.629358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b66e928c-50ae-4ff9-9a46-8ed38fb9ac48 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:15.639176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 727/1443] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:17.786105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4df026-82da-4d5c-afb7-c1120c4a45a1 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:17.786622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4df026-82da-4d5c-afb7-c1120c4a45a1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:17.786622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4df026-82da-4d5c-afb7-c1120c4a45a1 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:17.787924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 717/1444] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:17.793627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6217-b86e-4255-bfc7-65bc5f57943a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:17.794080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6217-b86e-4255-bfc7-65bc5f57943a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:17.794221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cab6217-b86e-4255-bfc7-65bc5f57943a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:17.812506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6cab6217-b86e-4255-bfc7-65bc5f57943a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:17.813815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6cab6217-b86e-4255-bfc7-65bc5f57943a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:17.822558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 728/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:17.859661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4df026-82da-4d5c-afb7-c1120c4a45a1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:17.871024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4df026-82da-4d5c-afb7-c1120c4a45a1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:17.874867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ba26598-78e2-48b1-b57f-d4402c4f913b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:17.875525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba26598-78e2-48b1-b57f-d4402c4f913b service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:17.875805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba26598-78e2-48b1-b57f-d4402c4f913b service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:17.876079 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ba26598-78e2-48b1-b57f-d4402c4f913b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:17.884804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba26598-78e2-48b1-b57f-d4402c4f913b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:17.886287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ba26598-78e2-48b1-b57f-d4402c4f913b service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:17.895462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 718/1446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:09:20.288358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247e29-21f1-4a4f-b74d-f960496926ec None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:20.292314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247e29-21f1-4a4f-b74d-f960496926ec None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:20.292314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42247e29-21f1-4a4f-b74d-f960496926ec None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:20.292314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 729/1447] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:20.295501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e212-c2d2-42ad-8d0e-e3804ac52a2a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:20.295930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e212-c2d2-42ad-8d0e-e3804ac52a2a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:20.296053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de7e212-c2d2-42ad-8d0e-e3804ac52a2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:20.313718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2de7e212-c2d2-42ad-8d0e-e3804ac52a2a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:20.314940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2de7e212-c2d2-42ad-8d0e-e3804ac52a2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:20.322585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 719/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:20.361023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247e29-21f1-4a4f-b74d-f960496926ec None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:20.371894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42247e29-21f1-4a4f-b74d-f960496926ec None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:20.375364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8c7f3f9-9734-4229-866c-c1a6bcb8f719 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:20.375990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7f3f9-9734-4229-866c-c1a6bcb8f719 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:20.376268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7f3f9-9734-4229-866c-c1a6bcb8f719 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:20.376542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8c7f3f9-9734-4229-866c-c1a6bcb8f719 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:20.385169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7f3f9-9734-4229-866c-c1a6bcb8f719 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:20.387147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8c7f3f9-9734-4229-866c-c1a6bcb8f719 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:20.396255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 730/1449] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:22.552746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2ad8-e8d8-4929-981b-d0e1f34e551b None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:22.553182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2ad8-e8d8-4929-981b-d0e1f34e551b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:22.553291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51be2ad8-e8d8-4929-981b-d0e1f34e551b None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:22.554713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 720/1450] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:22.560541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6a27-1608-4a0c-bbeb-a1e276b80067 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:22.560974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6a27-1608-4a0c-bbeb-a1e276b80067 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:22.561082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfa6a27-1608-4a0c-bbeb-a1e276b80067 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:22.578368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ecfa6a27-1608-4a0c-bbeb-a1e276b80067 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:22.579541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ecfa6a27-1608-4a0c-bbeb-a1e276b80067 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:22.587174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 731/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:22.627145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be2ad8-e8d8-4929-981b-d0e1f34e551b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:22.637642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51be2ad8-e8d8-4929-981b-d0e1f34e551b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:22.641127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ce340b-29ad-4b2b-998f-0fb0e870b4c7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:22.641757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce340b-29ad-4b2b-998f-0fb0e870b4c7 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:22.642122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce340b-29ad-4b2b-998f-0fb0e870b4c7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:22.642337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ce340b-29ad-4b2b-998f-0fb0e870b4c7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:22.650980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce340b-29ad-4b2b-998f-0fb0e870b4c7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:22.652965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ce340b-29ad-4b2b-998f-0fb0e870b4c7 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:22.662169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 721/1452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:24.814178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b734c-fe0c-4f80-be51-abae825b6caf None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:24.814742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b734c-fe0c-4f80-be51-abae825b6caf None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:24.814742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3b734c-fe0c-4f80-be51-abae825b6caf None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:24.816103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 732/1453] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:24.821359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186158f7-f566-4bc0-8b53-1e7163c39197 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:24.821805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186158f7-f566-4bc0-8b53-1e7163c39197 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:24.821918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-186158f7-f566-4bc0-8b53-1e7163c39197 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:24.840381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-186158f7-f566-4bc0-8b53-1e7163c39197 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:24.841562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-186158f7-f566-4bc0-8b53-1e7163c39197 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:24.849207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 722/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:24.887647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b734c-fe0c-4f80-be51-abae825b6caf None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:24.898169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3b734c-fe0c-4f80-be51-abae825b6caf None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:24.902243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5752f404-6337-4068-a4fa-f10c25b511e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:24.902874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752f404-6337-4068-a4fa-f10c25b511e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:24.903152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752f404-6337-4068-a4fa-f10c25b511e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:24.903428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5752f404-6337-4068-a4fa-f10c25b511e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:24.912409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752f404-6337-4068-a4fa-f10c25b511e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:24.913816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5752f404-6337-4068-a4fa-f10c25b511e1 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:24.922949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 733/1455] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:24 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:26.984629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980484-6fb1-46ce-bc9f-6e45c709ff1d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:26.985181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980484-6fb1-46ce-bc9f-6e45c709ff1d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:26.985181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3980484-6fb1-46ce-bc9f-6e45c709ff1d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:26.986643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 723/1456] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:26.992072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f810-24cb-470e-92bb-ee45141d9c52 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:26.992479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f810-24cb-470e-92bb-ee45141d9c52 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:26.992654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60f810-24cb-470e-92bb-ee45141d9c52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:27.010683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2c60f810-24cb-470e-92bb-ee45141d9c52 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:27.011855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2c60f810-24cb-470e-92bb-ee45141d9c52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:27.019523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 734/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:09:27.056964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980484-6fb1-46ce-bc9f-6e45c709ff1d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:27.068099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3980484-6fb1-46ce-bc9f-6e45c709ff1d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:27.071892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a812b8a-6944-49e4-b643-b99f01d3b6c8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:27.072513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a812b8a-6944-49e4-b643-b99f01d3b6c8 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:27.072795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a812b8a-6944-49e4-b643-b99f01d3b6c8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:27.073068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a812b8a-6944-49e4-b643-b99f01d3b6c8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:27.081703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a812b8a-6944-49e4-b643-b99f01d3b6c8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:27.083156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a812b8a-6944-49e4-b643-b99f01d3b6c8 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:27.092283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 724/1458] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:29.149202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cea0b0-8e3c-4908-a336-87d1c26e7d07 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:29.149740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cea0b0-8e3c-4908-a336-87d1c26e7d07 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:29.149740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8cea0b0-8e3c-4908-a336-87d1c26e7d07 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:29.151149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 735/1459] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:29.156849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f84b73-4e5e-4814-8f07-e606ed5b705f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:29.157251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f84b73-4e5e-4814-8f07-e606ed5b705f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:29.157406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f84b73-4e5e-4814-8f07-e606ed5b705f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:29.174604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-82f84b73-4e5e-4814-8f07-e606ed5b705f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:29.175785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-82f84b73-4e5e-4814-8f07-e606ed5b705f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:29.183454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 725/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:29.220444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cea0b0-8e3c-4908-a336-87d1c26e7d07 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:29.230879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8cea0b0-8e3c-4908-a336-87d1c26e7d07 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:29.234325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70e08be3-2930-4503-968c-1bb4a5c089ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:29.234954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e08be3-2930-4503-968c-1bb4a5c089ed service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:29.235239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e08be3-2930-4503-968c-1bb4a5c089ed service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:29.235516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70e08be3-2930-4503-968c-1bb4a5c089ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:29.244175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e08be3-2930-4503-968c-1bb4a5c089ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:29.245588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70e08be3-2930-4503-968c-1bb4a5c089ed service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:29.255048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 736/1461] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:31.286391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b027ab-56fd-4ee5-817e-676e6dd26178 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:31.286906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b027ab-56fd-4ee5-817e-676e6dd26178 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:31.286906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32b027ab-56fd-4ee5-817e-676e6dd26178 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:31.288214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 726/1462] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:31.294102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ce934-9b53-4914-9c5f-f3f84e7b392d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:31.294519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ce934-9b53-4914-9c5f-f3f84e7b392d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:31.294667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-622ce934-9b53-4914-9c5f-f3f84e7b392d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:31.300622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=79 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:09:31.312978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-622ce934-9b53-4914-9c5f-f3f84e7b392d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:31.319754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-622ce934-9b53-4914-9c5f-f3f84e7b392d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:31.322896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 737/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:31.360064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b027ab-56fd-4ee5-817e-676e6dd26178 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:31.365388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=73 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:09:31.371812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32b027ab-56fd-4ee5-817e-676e6dd26178 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:31.375319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197d6699-caf7-4519-9d29-22c3a6198d36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:31.375949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6699-caf7-4519-9d29-22c3a6198d36 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:31.376229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6699-caf7-4519-9d29-22c3a6198d36 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:31.376503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197d6699-caf7-4519-9d29-22c3a6198d36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:31.385117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6699-caf7-4519-9d29-22c3a6198d36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:31.386610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197d6699-caf7-4519-9d29-22c3a6198d36 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:31.395887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 727/1464] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:33.503652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032cfa0-a324-4686-b340-0a9533590a2c None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:33.504240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032cfa0-a324-4686-b340-0a9533590a2c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:33.504449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032cfa0-a324-4686-b340-0a9533590a2c None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:33.505832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 738/1465] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:33.511473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a3e9-8905-48a0-a394-7a598cc6c674 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:33.511907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a3e9-8905-48a0-a394-7a598cc6c674 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:33.512006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f2a3e9-8905-48a0-a394-7a598cc6c674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:33.529178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f9f2a3e9-8905-48a0-a394-7a598cc6c674 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:33.530379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f9f2a3e9-8905-48a0-a394-7a598cc6c674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:33.538373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 728/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:33.574509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032cfa0-a324-4686-b340-0a9533590a2c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:33.584996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032cfa0-a324-4686-b340-0a9533590a2c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:33.588495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61edc751-8770-4bc2-a728-fc4bc9af1e95 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:33.589128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc751-8770-4bc2-a728-fc4bc9af1e95 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:33.589410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc751-8770-4bc2-a728-fc4bc9af1e95 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:33.589685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61edc751-8770-4bc2-a728-fc4bc9af1e95 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:33.598480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc751-8770-4bc2-a728-fc4bc9af1e95 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:33.599901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61edc751-8770-4bc2-a728-fc4bc9af1e95 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:33.609596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 739/1467] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:35.643158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa348718-1f8a-455c-a5c5-8d4131fd3550 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:35.643645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa348718-1f8a-455c-a5c5-8d4131fd3550 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:35.643645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa348718-1f8a-455c-a5c5-8d4131fd3550 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:35.645003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 729/1468] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:35.650142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752c462-1658-40f1-ad8f-f4a072d8c1d5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:35.650921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752c462-1658-40f1-ad8f-f4a072d8c1d5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:35.651707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1752c462-1658-40f1-ad8f-f4a072d8c1d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:35.670336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1752c462-1658-40f1-ad8f-f4a072d8c1d5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:35.671517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1752c462-1658-40f1-ad8f-f4a072d8c1d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:35.679232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 740/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:09:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:35.715160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa348718-1f8a-455c-a5c5-8d4131fd3550 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:35.725572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa348718-1f8a-455c-a5c5-8d4131fd3550 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:35.729010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b58d07cc-85e8-49e4-89bc-faf172a879ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:35.730317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d07cc-85e8-49e4-89bc-faf172a879ac service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:35.730596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d07cc-85e8-49e4-89bc-faf172a879ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:35.730865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b58d07cc-85e8-49e4-89bc-faf172a879ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:35.739469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d07cc-85e8-49e4-89bc-faf172a879ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:35.740883 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b58d07cc-85e8-49e4-89bc-faf172a879ac service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:35.750312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 730/1470] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:09:45.664074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=11 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:09:45.745967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=14 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:09:55.402881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4bc9-f484-4353-9a4c-81d9a978a7ff None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:55.403384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4bc9-f484-4353-9a4c-81d9a978a7ff None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:55.403505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97e4bc9-f484-4353-9a4c-81d9a978a7ff None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:55.404775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 741/1471] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:55.409976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c68a3-5b4e-4269-b44b-6c2d98eb1765 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:55.410424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c68a3-5b4e-4269-b44b-6c2d98eb1765 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:55.410560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a04c68a3-5b4e-4269-b44b-6c2d98eb1765 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:55.428242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-a04c68a3-5b4e-4269-b44b-6c2d98eb1765 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:55.429424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a04c68a3-5b4e-4269-b44b-6c2d98eb1765 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:55.437721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 731/1472] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:55.521314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21e47-6e02-431b-8205-a7aa696a4970 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:55.521639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21e47-6e02-431b-8205-a7aa696a4970 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:55.521920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce21e47-6e02-431b-8205-a7aa696a4970 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:55.523440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 742/1473] 10.222.0.20 () {54 vars in 962 bytes} [Wed Jul 6 17:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:55.528464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ec29-86a0-4971-9439-0f76d3b40e80 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:55.528754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ec29-86a0-4971-9439-0f76d3b40e80 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:55.529033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9be0ec29-86a0-4971-9439-0f76d3b40e80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:55.547463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9be0ec29-86a0-4971-9439-0f76d3b40e80 None None] MFA Rules not processed for user `62d81f5f899b4113a6a54f0712725656`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:55.548671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9be0ec29-86a0-4971-9439-0f76d3b40e80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:55.555570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 732/1474] 10.222.0.20 () {58 vars in 1059 bytes} [Wed Jul 6 17:09:55 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:55.564104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21e47-6e02-431b-8205-a7aa696a4970 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:55.574716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce21e47-6e02-431b-8205-a7aa696a4970 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:55.578298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-690d941c-7fcb-4d33-a11c-e3e545caeaba service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:55.578926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d941c-7fcb-4d33-a11c-e3e545caeaba service glance] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:55.579206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d941c-7fcb-4d33-a11c-e3e545caeaba service glance] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:55.579482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-690d941c-7fcb-4d33-a11c-e3e545caeaba service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:55.588328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d941c-7fcb-4d33-a11c-e3e545caeaba service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:55.589749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-690d941c-7fcb-4d33-a11c-e3e545caeaba service glance] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:55.598868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 743/1475] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:09:57.684183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39374-bfec-4510-9379-57554b5cddc2 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:57.684703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39374-bfec-4510-9379-57554b5cddc2 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:57.684916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd39374-bfec-4510-9379-57554b5cddc2 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:57.686123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 733/1476] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:09:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:57.691200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b55a-8a9e-4192-96bf-39e216359d2d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:57.691578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b55a-8a9e-4192-96bf-39e216359d2d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:57.691788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6b3b55a-8a9e-4192-96bf-39e216359d2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:57.709516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e6b3b55a-8a9e-4192-96bf-39e216359d2d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:57.710734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e6b3b55a-8a9e-4192-96bf-39e216359d2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:57.719017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 744/1477] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:09:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:57.741563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39374-bfec-4510-9379-57554b5cddc2 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:57.753993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd39374-bfec-4510-9379-57554b5cddc2 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:57.758434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:57.759067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:57.759347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:57.759620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:57.760868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:57.762594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:09:57.762594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:09:57.762594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:09:57.763722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0714ee-550f-4c6d-9dbb-cc0cd9da3e86 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:57.783485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 734/1478] 10.222.0.20 () {56 vars in 1108 bytes} [Wed Jul 6 17:09:57 2022] GET /identity/v3/projects => generated 2553 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:09:59.798283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52b1b2-cd4f-4126-a383-a7478cf9b08d None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:59.798749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52b1b2-cd4f-4126-a383-a7478cf9b08d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:59.798853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d52b1b2-cd4f-4126-a383-a7478cf9b08d None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:59.800174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 745/1479] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:09:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:09:59.805519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a953-3b9f-46bb-ad2a-ffcf5ba85836 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:59.805963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a953-3b9f-46bb-ad2a-ffcf5ba85836 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:59.806090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24a0a953-3b9f-46bb-ad2a-ffcf5ba85836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:59.824234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-24a0a953-3b9f-46bb-ad2a-ffcf5ba85836 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:09:59.825423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-24a0a953-3b9f-46bb-ad2a-ffcf5ba85836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:09:59.833135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 735/1480] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:09:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:09:59.876039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52b1b2-cd4f-4126-a383-a7478cf9b08d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:09:59.890840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d52b1b2-cd4f-4126-a383-a7478cf9b08d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:09:59.896305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06d72dc7-914c-409b-94d1-f521e5795656 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:09:59.896938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d72dc7-914c-409b-94d1-f521e5795656 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:09:59.897222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d72dc7-914c-409b-94d1-f521e5795656 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:09:59.897500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06d72dc7-914c-409b-94d1-f521e5795656 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:09:59.906489 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d72dc7-914c-409b-94d1-f521e5795656 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:09:59.908061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06d72dc7-914c-409b-94d1-f521e5795656 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:09:59.917472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 746/1481] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:09:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:10:02.107324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391e6d-e358-4781-a118-89407d37fa0e None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:02.107865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391e6d-e358-4781-a118-89407d37fa0e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:02.107979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b391e6d-e358-4781-a118-89407d37fa0e None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:02.109285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 736/1482] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:10:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:10:02.114591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d684964-53a8-4139-a8fb-f5c6af5d06ce None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:02.115043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d684964-53a8-4139-a8fb-f5c6af5d06ce None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:02.115140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d684964-53a8-4139-a8fb-f5c6af5d06ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:02.133264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8d684964-53a8-4139-a8fb-f5c6af5d06ce None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:10:02.134475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8d684964-53a8-4139-a8fb-f5c6af5d06ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:10:02.142239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 747/1483] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:10:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:10:02.177821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391e6d-e358-4781-a118-89407d37fa0e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:10:02.189032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b391e6d-e358-4781-a118-89407d37fa0e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:10:02.192595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9be0a7a-efbd-49f6-a6c6-5d4204e8c904 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:10:02.193225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0a7a-efbd-49f6-a6c6-5d4204e8c904 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:02.193505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0a7a-efbd-49f6-a6c6-5d4204e8c904 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:02.193785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9be0a7a-efbd-49f6-a6c6-5d4204e8c904 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:02.202564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0a7a-efbd-49f6-a6c6-5d4204e8c904 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:10:02.203982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9be0a7a-efbd-49f6-a6c6-5d4204e8c904 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:10:02.213612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 737/1484] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:10:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:10:04.281346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abcec-dd15-405a-a51f-72f0ec2c98c8 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:04.281868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abcec-dd15-405a-a51f-72f0ec2c98c8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:04.281868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546abcec-dd15-405a-a51f-72f0ec2c98c8 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:04.283220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 748/1485] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:10:04.288373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992157-8bb3-487f-a827-b11715ab370b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:04.288825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992157-8bb3-487f-a827-b11715ab370b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:04.288922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75992157-8bb3-487f-a827-b11715ab370b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:04.307157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-75992157-8bb3-487f-a827-b11715ab370b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:10:04.308350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-75992157-8bb3-487f-a827-b11715ab370b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:10:04.316155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 738/1486] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:10:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:10:04.354370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abcec-dd15-405a-a51f-72f0ec2c98c8 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:10:04.364956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546abcec-dd15-405a-a51f-72f0ec2c98c8 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:10:04.368463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-870bc9bb-69fb-4b94-a536-1a954b7e6a05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:10:04.369094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc9bb-69fb-4b94-a536-1a954b7e6a05 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:04.369379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc9bb-69fb-4b94-a536-1a954b7e6a05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:04.369662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-870bc9bb-69fb-4b94-a536-1a954b7e6a05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:04.378721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc9bb-69fb-4b94-a536-1a954b7e6a05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:10:04.380147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-870bc9bb-69fb-4b94-a536-1a954b7e6a05 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:10:04.389910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 749/1487] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:10:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:10:06.487262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f98b1-e4e2-4a5c-8979-f08cb362126a None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:06.487809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f98b1-e4e2-4a5c-8979-f08cb362126a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:06.487809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f98b1-e4e2-4a5c-8979-f08cb362126a None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:06.489173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 739/1488] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:10:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:10:06.494292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2119c-6e8d-4483-a8d9-489dc09c559c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:06.494696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2119c-6e8d-4483-a8d9-489dc09c559c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:06.494847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dc2119c-6e8d-4483-a8d9-489dc09c559c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:06.512290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2dc2119c-6e8d-4483-a8d9-489dc09c559c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:10:06.513456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2dc2119c-6e8d-4483-a8d9-489dc09c559c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:10:06.521191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 750/1489] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:10:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:10:06.563004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f98b1-e4e2-4a5c-8979-f08cb362126a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:10:06.574374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f98b1-e4e2-4a5c-8979-f08cb362126a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:10:06.577820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f1c0cc-248d-4a22-b421-081a0a40834a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:10:06.578562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c0cc-248d-4a22-b421-081a0a40834a service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:06.578845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c0cc-248d-4a22-b421-081a0a40834a service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:06.579122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f1c0cc-248d-4a22-b421-081a0a40834a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:06.588704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1c0cc-248d-4a22-b421-081a0a40834a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:10:06.590110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f1c0cc-248d-4a22-b421-081a0a40834a service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:10:06.599407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 740/1490] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:10:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:10:08.958114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e121-5b26-410c-94e5-13754b468041 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:08.958648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e121-5b26-410c-94e5-13754b468041 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:08.958744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a2e121-5b26-410c-94e5-13754b468041 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:08.960069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 751/1491] 10.222.0.20 () {54 vars in 926 bytes} [Wed Jul 6 17:10:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:10:08.965138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381b4c-21af-4db5-8ef6-f3a66e11b161 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:08.965591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381b4c-21af-4db5-8ef6-f3a66e11b161 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:08.965689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2381b4c-21af-4db5-8ef6-f3a66e11b161 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:08.983489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b2381b4c-21af-4db5-8ef6-f3a66e11b161 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:10:08.984668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b2381b4c-21af-4db5-8ef6-f3a66e11b161 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:10:08.992239 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 741/1492] 10.222.0.20 () {58 vars in 1023 bytes} [Wed Jul 6 17:10:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:10:09.030551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e121-5b26-410c-94e5-13754b468041 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:10:09.040947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a2e121-5b26-410c-94e5-13754b468041 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:10:09.045185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a189cdc-cc77-475e-bef7-25949db8166d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:10:09.045829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189cdc-cc77-475e-bef7-25949db8166d service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:10:09.046162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189cdc-cc77-475e-bef7-25949db8166d service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:10:09.046445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a189cdc-cc77-475e-bef7-25949db8166d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:10:09.055431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189cdc-cc77-475e-bef7-25949db8166d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:10:09.057478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a189cdc-cc77-475e-bef7-25949db8166d service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:10:09.066838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 752/1493] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:10:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:10:18.977975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=33 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:10:19.062603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=33 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:11:42.985183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:42.985804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:42.985804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.005562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:11:43.006841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:43.015020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 742/1494] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:11:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:11:43.023351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.023955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.024063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.043552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:11:43.044826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:43.053236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 753/1495] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:11:43.058374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.068001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4486786a-08c8-4d54-966a-4a8bd64d2d34 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.072868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.084823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.084823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.084823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.084823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:11:43.084823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.085284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.085284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:11:43.085284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:11:43.085284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.088921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 743/1496] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:11:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:11:43.097371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.107108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25edd3b2-c796-4bfe-b3ee-0c6642988180 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.111623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.114637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.114637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.114637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.114637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.115425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.115425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:11:43.115425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:11:43.116628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.224964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 754/1497] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:11:43 2022] POST /identity/v3/projects => generated 379 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:11:43.229673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.239594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8dc645-5cf7-4c63-8bd7-fbac2e619ac3 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.295364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.296031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.296317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.296596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.297291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.298337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.298337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:11:43.298337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:11:43.299548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.372678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 744/1498] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:11:43 2022] POST /identity/v3/users => generated 290 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:11:43.376827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.387539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a0d2459-59da-494f-bd3c-17f4b9f84094 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.392037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.392688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.392976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.393256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.393982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.399510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.399510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:11:43.399510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:11:43.399510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.408685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 755/1499] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:11:43.412499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.422275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-886b635c-863f-4090-8318-ff9ad7f3167f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.426638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.427284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.427563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.427837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.428558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.429551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.429551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:11:43.429551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:11:43.430460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bcebb02-8471-40df-8997-364072553a87 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.443349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 745/1500] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:11:43 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:11:43.447227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.457554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4881e369-2048-42a8-b43f-881f66823eba admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.462299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.463165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.463449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.463725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] PATH_INFO: `/v3/projects/ab2f93d4a830475ca62acb98daa134a7/users/8d14f74864514e3891556f80bbcf385d/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.478434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] RBAC: Authorizing `identity:create_grant(project_id=ab2f93d4a830475ca62acb98daa134a7, user_id=8d14f74864514e3891556f80bbcf385d, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.479494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.479494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:11:43.479494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:11:43.481401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a9fcdfd-e528-4040-8afc-bfe59642194d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.553975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 756/1501] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:11:43 2022] PUT /identity/v3/projects/ab2f93d4a830475ca62acb98daa134a7/users/8d14f74864514e3891556f80bbcf385d/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:11:43.566692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad7d6-c165-4cee-a7e9-ae457216af94 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.566980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad7d6-c165-4cee-a7e9-ae457216af94 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.567256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325ad7d6-c165-4cee-a7e9-ae457216af94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.593379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-325ad7d6-c165-4cee-a7e9-ae457216af94 None None] MFA Rules not processed for user `8d14f74864514e3891556f80bbcf385d`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:11:43.594593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-325ad7d6-c165-4cee-a7e9-ae457216af94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:43.657848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 746/1502] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:11:43.670964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac400574-78bc-4489-b020-a3de94712ca0 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.671270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac400574-78bc-4489-b020-a3de94712ca0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.671548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac400574-78bc-4489-b020-a3de94712ca0 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.672886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 757/1503] 10.222.0.20 () {54 vars in 963 bytes} [Wed Jul 6 17:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:11:43.677698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c527a9-63f2-4f48-8dc6-05bb825aa5e1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.677992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c527a9-63f2-4f48-8dc6-05bb825aa5e1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.678312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c527a9-63f2-4f48-8dc6-05bb825aa5e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.696483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-80c527a9-63f2-4f48-8dc6-05bb825aa5e1 None None] MFA Rules not processed for user `ba635abc81fd47c6b680836c67eeeeea`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:11:43.697682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-80c527a9-63f2-4f48-8dc6-05bb825aa5e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:43.741702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:11:43.750116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 747/1504] 10.222.0.20 () {58 vars in 1060 bytes} [Wed Jul 6 17:11:43 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 73 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:11:43.757764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac400574-78bc-4489-b020-a3de94712ca0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.769229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac400574-78bc-4489-b020-a3de94712ca0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.772863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.773502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.773779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.774082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.782452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.783951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:43.793449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 758/1505] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:11:43 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:11:43.847100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2f80-1bbd-4738-b964-9f37db477ff9 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.847392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2f80-1bbd-4738-b964-9f37db477ff9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.847672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72bb2f80-1bbd-4738-b964-9f37db477ff9 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.848989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 748/1506] 10.222.0.20 () {52 vars in 829 bytes} [Wed Jul 6 17:11:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 17:11:43.853156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:43.924466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f5aff3-e33a-4aa2-a252-a4f723f38b5d service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:43.929003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:43.929924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:43.930261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:43.930537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] PATH_INFO: `/v3/users/8d14f74864514e3891556f80bbcf385d` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:43.931719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8d14f74864514e3891556f80bbcf385d)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:43.933359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:43.933359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:11:43.933359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:11:43.934625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:44.323890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8d14f74864514e3891556f80bbcf385d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:44.342082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8d14f74864514e3891556f80bbcf385d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:44.354712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8d14f74864514e3891556f80bbcf385d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:44.355480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8d14f74864514e3891556f80bbcf385d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:44.359389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:11:44.477727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8d14f74864514e3891556f80bbcf385d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:44.484457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 759/1507] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:11:43 2022] DELETE /identity/v3/users/8d14f74864514e3891556f80bbcf385d => generated 0 bytes in 632 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:11:44.488833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:44.489301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:44.489405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:44.506578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:11:44.507772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:44.566536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 749/1508] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:11:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:11:44.577009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:44.578493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:44.636859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0632c582-c2aa-4ca9-a1ac-c776b7d22d89 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:44.640453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b11224b1-5dd6-46e5-b1a4-de6d9aa56203 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:44.641094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11224b1-5dd6-46e5-b1a4-de6d9aa56203 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:44.641379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11224b1-5dd6-46e5-b1a4-de6d9aa56203 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:44.641659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b11224b1-5dd6-46e5-b1a4-de6d9aa56203 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:44.650547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11224b1-5dd6-46e5-b1a4-de6d9aa56203 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:44.652593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b11224b1-5dd6-46e5-b1a4-de6d9aa56203 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:44.661872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 760/1509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:11:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:11:45.116454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:11:45.117909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:11:45.129932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e28efbe2-b777-4795-be77-ad7cf13587d0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:11:45.134906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:11:45.136375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:11:45.136657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:11:45.136932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] PATH_INFO: `/v3/projects/ab2f93d4a830475ca62acb98daa134a7` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:11:45.138150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] RBAC: Authorizing `identity:delete_project(project_id=ab2f93d4a830475ca62acb98daa134a7)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:11:45.139157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:11:45.139157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:11:45.139157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:11:45.140360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:11:45.273264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ab2f93d4a830475ca62acb98daa134a7', 'request_id': 'req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:45.279223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ab2f93d4a830475ca62acb98daa134a7', 'request_id': 'req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:45.292709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ab2f93d4a830475ca62acb98daa134a7', 'request_id': 'req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:45.391231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] The token cache is being invalidate because project ab2f93d4a830475ca62acb98daa134a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:11:45.391451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:45.392161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8ab5e649-cc61-4a36-a96e-59a8d926ad4a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:11:45.393712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 750/1510] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:11:45 2022] DELETE /identity/v3/projects/ab2f93d4a830475ca62acb98daa134a7 => generated 0 bytes in 278 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:11:54.657794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:11:55.388111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:13:31.152518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a757f1f-0d1c-4484-adb8-b871e029d05f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:31.153691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a757f1f-0d1c-4484-adb8-b871e029d05f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:31.153691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a757f1f-0d1c-4484-adb8-b871e029d05f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:31.155049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 761/1511] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:13:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:31.159909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4db799-dbba-49cb-be71-e03b534e0e21 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:31.160321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4db799-dbba-49cb-be71-e03b534e0e21 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:31.160469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c4db799-dbba-49cb-be71-e03b534e0e21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:31.179743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8c4db799-dbba-49cb-be71-e03b534e0e21 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:31.181006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8c4db799-dbba-49cb-be71-e03b534e0e21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:31.238414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 751/1512] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:13:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:31.392908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a757f1f-0d1c-4484-adb8-b871e029d05f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:31.394689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6a757f1f-0d1c-4484-adb8-b871e029d05f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:31.468405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a757f1f-0d1c-4484-adb8-b871e029d05f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:31.473673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab66f349-e98e-4de6-95a5-714067ef7931 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:31.474340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66f349-e98e-4de6-95a5-714067ef7931 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:31.474624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66f349-e98e-4de6-95a5-714067ef7931 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:31.474899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab66f349-e98e-4de6-95a5-714067ef7931 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:31.483419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66f349-e98e-4de6-95a5-714067ef7931 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:31.484991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab66f349-e98e-4de6-95a5-714067ef7931 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:31.494460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 762/1513] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:32.323462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0a06-dc00-4b79-8edb-e67d2ddec7d1 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:32.324008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0a06-dc00-4b79-8edb-e67d2ddec7d1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:32.324008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75dd0a06-dc00-4b79-8edb-e67d2ddec7d1 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:32.325419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 752/1514] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:13:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:32.330214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdcbd4-2c64-4b80-9f68-029284274840 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:32.330628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdcbd4-2c64-4b80-9f68-029284274840 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:32.330776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87fdcbd4-2c64-4b80-9f68-029284274840 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:32.348891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-87fdcbd4-2c64-4b80-9f68-029284274840 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:32.350120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-87fdcbd4-2c64-4b80-9f68-029284274840 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:32.358419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 763/1515] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:13:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:32.509348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0a06-dc00-4b79-8edb-e67d2ddec7d1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:32.523861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75dd0a06-dc00-4b79-8edb-e67d2ddec7d1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:32.532946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165db6df-6f46-4b6c-b8b8-61efdf3387d2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:32.533601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db6df-6f46-4b6c-b8b8-61efdf3387d2 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:32.533882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db6df-6f46-4b6c-b8b8-61efdf3387d2 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:32.534187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165db6df-6f46-4b6c-b8b8-61efdf3387d2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:32.542898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165db6df-6f46-4b6c-b8b8-61efdf3387d2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:32.544556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165db6df-6f46-4b6c-b8b8-61efdf3387d2 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:32.554221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 753/1516] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:32.903376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3200018-f0e7-43a2-99e5-db27b91e14af None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:32.903583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3200018-f0e7-43a2-99e5-db27b91e14af None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:32.903856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3200018-f0e7-43a2-99e5-db27b91e14af None None] PATH_INFO: `/v3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:32.905155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 764/1517] 10.222.0.43 () {54 vars in 925 bytes} [Wed Jul 6 17:13:32 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:13:32.911789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf223024-1464-4617-95bd-09d66106457c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:32.912080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf223024-1464-4617-95bd-09d66106457c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:32.912357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf223024-1464-4617-95bd-09d66106457c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:32.930307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cf223024-1464-4617-95bd-09d66106457c None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:32.931491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cf223024-1464-4617-95bd-09d66106457c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:32.994509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 754/1518] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 6 17:13:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:36.941148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d229d-0596-4562-9c73-0af294e35b8d None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:36.941670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d229d-0596-4562-9c73-0af294e35b8d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:36.941670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8d229d-0596-4562-9c73-0af294e35b8d None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:36.942995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 765/1519] 10.222.0.20 () {54 vars in 960 bytes} [Wed Jul 6 17:13:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:36.947959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c106bae-66c1-48b5-8343-ac2a78a7e7ab None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:36.948380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c106bae-66c1-48b5-8343-ac2a78a7e7ab None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:36.948546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c106bae-66c1-48b5-8343-ac2a78a7e7ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:36.966570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2c106bae-66c1-48b5-8343-ac2a78a7e7ab None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:36.967743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2c106bae-66c1-48b5-8343-ac2a78a7e7ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:36.976649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 755/1520] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Jul 6 17:13:36 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:36.983958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d229d-0596-4562-9c73-0af294e35b8d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:36.997328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8d229d-0596-4562-9c73-0af294e35b8d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:37.002207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3496dc-93ab-4f7c-afca-e26af46bb98c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:37.002834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3496dc-93ab-4f7c-afca-e26af46bb98c service placement] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:37.003114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3496dc-93ab-4f7c-afca-e26af46bb98c service placement] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:37.003388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3496dc-93ab-4f7c-afca-e26af46bb98c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:37.011472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3496dc-93ab-4f7c-afca-e26af46bb98c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:37.013029 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3496dc-93ab-4f7c-afca-e26af46bb98c service placement] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:37.022948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 766/1521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:36 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:43.772277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae19d-90f2-42ac-8985-239bea674d2d None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:43.772888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae19d-90f2-42ac-8985-239bea674d2d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:43.772888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308ae19d-90f2-42ac-8985-239bea674d2d None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:43.774246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 756/1522] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:43.778985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4c9f1-4439-47cb-a365-a93fed51526a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:43.779388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4c9f1-4439-47cb-a365-a93fed51526a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:43.779637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c4c9f1-4439-47cb-a365-a93fed51526a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:43.798384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-19c4c9f1-4439-47cb-a365-a93fed51526a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:43.799577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-19c4c9f1-4439-47cb-a365-a93fed51526a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:43.807275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 767/1523] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:43.960306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae19d-90f2-42ac-8985-239bea674d2d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:43.975162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308ae19d-90f2-42ac-8985-239bea674d2d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:43.980395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-460b8982-7829-42ca-abdb-e1e906c6814e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:43.981060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8982-7829-42ca-abdb-e1e906c6814e service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:43.981341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8982-7829-42ca-abdb-e1e906c6814e service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:43.981613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-460b8982-7829-42ca-abdb-e1e906c6814e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:43.990313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b8982-7829-42ca-abdb-e1e906c6814e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:43.992223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-460b8982-7829-42ca-abdb-e1e906c6814e service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:44.001517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 757/1524] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:44.816683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d45b72-ccc6-439d-ae31-668fba750519 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:44.817199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d45b72-ccc6-439d-ae31-668fba750519 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:44.817311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d45b72-ccc6-439d-ae31-668fba750519 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:44.818631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 768/1525] 127.0.0.1 () {54 vars in 901 bytes} [Wed Jul 6 17:13:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:44.823364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d818ee3-c564-4101-8c11-60c678388598 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:44.823768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d818ee3-c564-4101-8c11-60c678388598 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:44.823935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d818ee3-c564-4101-8c11-60c678388598 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:44.842333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9d818ee3-c564-4101-8c11-60c678388598 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:44.844046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9d818ee3-c564-4101-8c11-60c678388598 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:44.852168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 758/1526] 127.0.0.1 () {58 vars in 998 bytes} [Wed Jul 6 17:13:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:45.002280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d45b72-ccc6-439d-ae31-668fba750519 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:45.016267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d45b72-ccc6-439d-ae31-668fba750519 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:45.021624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d1d3e8-3bbb-419a-a5d3-569c863ebb11 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:45.022312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1d3e8-3bbb-419a-a5d3-569c863ebb11 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:45.022601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1d3e8-3bbb-419a-a5d3-569c863ebb11 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:45.022884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d1d3e8-3bbb-419a-a5d3-569c863ebb11 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:45.031685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1d3e8-3bbb-419a-a5d3-569c863ebb11 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:45.033299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d1d3e8-3bbb-419a-a5d3-569c863ebb11 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:45.042779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 769/1527] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:48.881304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4bddb-16b3-4e8f-972c-f20907f5ad41 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:48.881856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4bddb-16b3-4e8f-972c-f20907f5ad41 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:48.881966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fd4bddb-16b3-4e8f-972c-f20907f5ad41 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:48.883306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 759/1528] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:13:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:48.888408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60037-5ba6-4733-9eca-b2a3e5a0a975 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:48.888830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60037-5ba6-4733-9eca-b2a3e5a0a975 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:48.888970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a60037-5ba6-4733-9eca-b2a3e5a0a975 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:48.907932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d8a60037-5ba6-4733-9eca-b2a3e5a0a975 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:48.909110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d8a60037-5ba6-4733-9eca-b2a3e5a0a975 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:48.916896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 770/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:48.988641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4bddb-16b3-4e8f-972c-f20907f5ad41 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:48.990389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1fd4bddb-16b3-4e8f-972c-f20907f5ad41 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:49.047387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fd4bddb-16b3-4e8f-972c-f20907f5ad41 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:49.050972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f917ef5a-2542-4640-995f-dd98b83503da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:49.051610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ef5a-2542-4640-995f-dd98b83503da service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:49.051895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ef5a-2542-4640-995f-dd98b83503da service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:49.052174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f917ef5a-2542-4640-995f-dd98b83503da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:49.061054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917ef5a-2542-4640-995f-dd98b83503da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:49.062613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f917ef5a-2542-4640-995f-dd98b83503da service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:49.067462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:13:49.074047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 760/1530] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:51.072760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8e40-9104-459d-89b4-0ba389c6960e None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:51.073331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8e40-9104-459d-89b4-0ba389c6960e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:51.073620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcaf8e40-9104-459d-89b4-0ba389c6960e None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:51.075059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 771/1531] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:51.080769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd5a1f-9c42-4e85-88ae-12f332196112 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:51.081213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd5a1f-9c42-4e85-88ae-12f332196112 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:51.081318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8cd5a1f-9c42-4e85-88ae-12f332196112 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:51.099517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c8cd5a1f-9c42-4e85-88ae-12f332196112 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:51.100712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c8cd5a1f-9c42-4e85-88ae-12f332196112 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:51.108386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 761/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:51.143833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8e40-9104-459d-89b4-0ba389c6960e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:51.154479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcaf8e40-9104-459d-89b4-0ba389c6960e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:51.158590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb10b965-4310-4e55-be83-cd5f3b0d0cc1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:51.159223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b965-4310-4e55-be83-cd5f3b0d0cc1 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:51.159505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b965-4310-4e55-be83-cd5f3b0d0cc1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:51.159785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb10b965-4310-4e55-be83-cd5f3b0d0cc1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:51.168995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10b965-4310-4e55-be83-cd5f3b0d0cc1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:51.170468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb10b965-4310-4e55-be83-cd5f3b0d0cc1 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:51.179810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 772/1533] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:55.036681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38580-431b-45b1-9af9-331acfc7d059 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:55.037242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38580-431b-45b1-9af9-331acfc7d059 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:55.037242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b38580-431b-45b1-9af9-331acfc7d059 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:55.038647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 762/1534] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:13:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:55.043761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17937-9a1d-4e01-9fe3-90085577a8d1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:55.044176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17937-9a1d-4e01-9fe3-90085577a8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:55.044343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af17937-9a1d-4e01-9fe3-90085577a8d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:55.051224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=62 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:13:55.063460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5af17937-9a1d-4e01-9fe3-90085577a8d1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:55.064649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5af17937-9a1d-4e01-9fe3-90085577a8d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:55.072451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 773/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:13:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:55.371400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38580-431b-45b1-9af9-331acfc7d059 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:55.373104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-05b38580-431b-45b1-9af9-331acfc7d059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:55.432554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b38580-431b-45b1-9af9-331acfc7d059 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:55.436043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a26f52d-f0ec-4100-bc5e-558b36c3e694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:55.436683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26f52d-f0ec-4100-bc5e-558b36c3e694 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:55.436964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26f52d-f0ec-4100-bc5e-558b36c3e694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:55.437240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a26f52d-f0ec-4100-bc5e-558b36c3e694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:55.446206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26f52d-f0ec-4100-bc5e-558b36c3e694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:55.447624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a26f52d-f0ec-4100-bc5e-558b36c3e694 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:55.456971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 763/1536] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:13:57.490156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842d4c5-f828-48e4-a53a-f8d27fe9275a None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:57.490722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842d4c5-f828-48e4-a53a-f8d27fe9275a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:57.490722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7842d4c5-f828-48e4-a53a-f8d27fe9275a None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:57.492064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 774/1537] 127.0.0.1 () {54 vars in 916 bytes} [Wed Jul 6 17:13:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:13:57.497560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c5fd-77cf-4044-9465-b94c0d3d5831 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:57.497960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c5fd-77cf-4044-9465-b94c0d3d5831 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:57.498163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a6c5fd-77cf-4044-9465-b94c0d3d5831 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:57.633411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e9a6c5fd-77cf-4044-9465-b94c0d3d5831 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:13:57.634692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e9a6c5fd-77cf-4044-9465-b94c0d3d5831 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:57.642887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 764/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Wed Jul 6 17:13:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:13:57.961584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842d4c5-f828-48e4-a53a-f8d27fe9275a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:13:57.963294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7842d4c5-f828-48e4-a53a-f8d27fe9275a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:13:57.976144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7842d4c5-f828-48e4-a53a-f8d27fe9275a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:13:57.979628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d65031a8-5b3e-4d2f-a63a-82982e989aa9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:13:57.980259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65031a8-5b3e-4d2f-a63a-82982e989aa9 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:13:57.980542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65031a8-5b3e-4d2f-a63a-82982e989aa9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:13:57.980817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d65031a8-5b3e-4d2f-a63a-82982e989aa9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:13:57.990453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65031a8-5b3e-4d2f-a63a-82982e989aa9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:13:57.995225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d65031a8-5b3e-4d2f-a63a-82982e989aa9 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:13:58.002049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 775/1539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:13:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:14:07.510836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=32 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:14:07.997271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=8 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:28.640452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d1a1-29dc-4a45-989e-094c85aee727 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.641600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d1a1-29dc-4a45-989e-094c85aee727 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.642167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec5d1a1-29dc-4a45-989e-094c85aee727 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.663890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7ec5d1a1-29dc-4a45-989e-094c85aee727 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:28.665086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7ec5d1a1-29dc-4a45-989e-094c85aee727 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:28.676054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b44fd-a4e3-48d6-b86f-43a89f77dba7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.676653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b44fd-a4e3-48d6-b86f-43a89f77dba7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.676653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80b44fd-a4e3-48d6-b86f-43a89f77dba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.678416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 765/1540] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:28.687166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.687472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.687721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.711847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c80b44fd-a4e3-48d6-b86f-43a89f77dba7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:28.713268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c80b44fd-a4e3-48d6-b86f-43a89f77dba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:28.716367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:28.717582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:28.734982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 766/1541] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:28.735565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 776/1542] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 61 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:28.740410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:28.746687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df85a-b923-4964-aecf-afff31c5136b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.747033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df85a-b923-4964-aecf-afff31c5136b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.747273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577df85a-b923-4964-aecf-afff31c5136b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.754830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e275f55-8ba1-4a4d-8921-c17304cf7035 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:28.766789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:28.767440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.767764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.768039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.768780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:28.769085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:28.770775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:28.789404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 767/1543] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:28.798059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-577df85a-b923-4964-aecf-afff31c5136b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:28.798666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:28.800093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-577df85a-b923-4964-aecf-afff31c5136b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:28.818343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-334abd50-8da3-429d-bffc-2421d396383c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:28.826230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:28.826900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.827181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.827456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.828146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:28.829109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 777/1544] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:28.829240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:15:28.829240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:15:28.829240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:15:28.830483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:28.834058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df85a-b923-4964-aecf-afff31c5136b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:28.857979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577df85a-b923-4964-aecf-afff31c5136b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:28.874700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:28.875581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.875873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.876151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.876892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:28.877227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:28.878411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:15:28.878411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:15:28.878411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:15:28.879318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:28.896391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 778/1545] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:15:28.904617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:28.919454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bc72be7-027f-41ff-8dcb-00b947b497cf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:28.928363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7333093-f936-43c0-a4cf-1816bf7db546 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:28.929030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333093-f936-43c0-a4cf-1816bf7db546 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:28.929312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333093-f936-43c0-a4cf-1816bf7db546 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:28.929586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7333093-f936-43c0-a4cf-1816bf7db546 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:28.930315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7333093-f936-43c0-a4cf-1816bf7db546 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:28.932245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7333093-f936-43c0-a4cf-1816bf7db546 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:28.951431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 768/1546] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/projects => generated 369 bytes in 154 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:15:28.961064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.046124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729e0b90-66c2-4bfc-9320-2d2bc488d4cc admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.053973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.054678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.055071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.055349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.056046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.056988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 779/1547] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/projects => generated 377 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:15:29.058074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.058416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a0e4e-09f6-469a-8741-c7690ab35fb0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.058708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a0e4e-09f6-469a-8741-c7690ab35fb0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.058987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e88a0e4e-09f6-469a-8741-c7690ab35fb0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.103073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e88a0e4e-09f6-469a-8741-c7690ab35fb0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.104410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e88a0e4e-09f6-469a-8741-c7690ab35fb0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.156868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 769/1548] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:28 2022] POST /identity/v3/users => generated 285 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:29.157696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.172310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c9a9f9a-8af5-431d-808b-ebccb64d69a3 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.191310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 780/1549] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.192592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f18fd-bbfe-4ddd-bef4-a274537535f2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.192879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f18fd-bbfe-4ddd-bef4-a274537535f2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.193156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-026f18fd-bbfe-4ddd-bef4-a274537535f2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.211042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-026f18fd-bbfe-4ddd-bef4-a274537535f2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.212859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-026f18fd-bbfe-4ddd-bef4-a274537535f2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.220883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 781/1550] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.222760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3494f-38d6-4d86-99a8-8a94c65304fe None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.223061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3494f-38d6-4d86-99a8-8a94c65304fe None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.223331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afd3494f-38d6-4d86-99a8-8a94c65304fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.241789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99938d0b-bebe-4ca1-befc-be21e4aaef78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.242775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99938d0b-bebe-4ca1-befc-be21e4aaef78 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.243113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99938d0b-bebe-4ca1-befc-be21e4aaef78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.243391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99938d0b-bebe-4ca1-befc-be21e4aaef78 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.243500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-afd3494f-38d6-4d86-99a8-8a94c65304fe None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.244104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99938d0b-bebe-4ca1-befc-be21e4aaef78 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.244685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-afd3494f-38d6-4d86-99a8-8a94c65304fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.246074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99938d0b-bebe-4ca1-befc-be21e4aaef78 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.252540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 782/1551] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.255254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.255534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.255804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.274119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.275318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.283151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 783/1552] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.284606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.293685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7682c21-be48-42f2-a5e6-ca8660c46285 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.298206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf94a39-8463-47b0-8883-caf62a6f42ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.298867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94a39-8463-47b0-8883-caf62a6f42ae admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.299194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94a39-8463-47b0-8883-caf62a6f42ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.299475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf94a39-8463-47b0-8883-caf62a6f42ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.300194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf94a39-8463-47b0-8883-caf62a6f42ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.301790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf94a39-8463-47b0-8883-caf62a6f42ae admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.311396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 784/1553] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:29.312685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c89e-0858-4bed-b4e2-79acb54addf1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.312976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c89e-0858-4bed-b4e2-79acb54addf1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.313254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9d1c89e-0858-4bed-b4e2-79acb54addf1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.331291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c9d1c89e-0858-4bed-b4e2-79acb54addf1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.332523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c9d1c89e-0858-4bed-b4e2-79acb54addf1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.340448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 785/1554] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.341740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601726-e6d1-47f6-8be2-1813ed936d34 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.342049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601726-e6d1-47f6-8be2-1813ed936d34 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.342327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f601726-e6d1-47f6-8be2-1813ed936d34 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.352939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 770/1555] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/users => generated 289 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:29.354577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968a05-b4d2-41ca-a3f1-6fd0e850d08a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.355059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968a05-b4d2-41ca-a3f1-6fd0e850d08a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.355367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56968a05-b4d2-41ca-a3f1-6fd0e850d08a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.361975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3f601726-e6d1-47f6-8be2-1813ed936d34 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.363211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3f601726-e6d1-47f6-8be2-1813ed936d34 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.371840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 786/1556] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.373036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d67b-6188-4b3b-a17f-20c644c5ba63 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.373321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d67b-6188-4b3b-a17f-20c644c5ba63 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.373494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-56968a05-b4d2-41ca-a3f1-6fd0e850d08a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.373589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7d67b-6188-4b3b-a17f-20c644c5ba63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.374549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-56968a05-b4d2-41ca-a3f1-6fd0e850d08a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.383416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 771/1557] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.384655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.384938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.385207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.393792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4bc7d67b-6188-4b3b-a17f-20c644c5ba63 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.395028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4bc7d67b-6188-4b3b-a17f-20c644c5ba63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.403000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.403408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 787/1558] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.404141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.404601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621896e2-683b-4d35-8a8d-4a788377699c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.404947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621896e2-683b-4d35-8a8d-4a788377699c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.405165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621896e2-683b-4d35-8a8d-4a788377699c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.414167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 772/1559] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.414167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.422724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-621896e2-683b-4d35-8a8d-4a788377699c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.424132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54a7b6aa-ffdf-476e-ba64-446de8242459 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.424278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-621896e2-683b-4d35-8a8d-4a788377699c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.427334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.427972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.428250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.428525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.429240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.430843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.431913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 788/1560] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.433103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c059e0-3256-4dd2-ad69-d2e89c0ca012 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.433394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c059e0-3256-4dd2-ad69-d2e89c0ca012 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.433676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c059e0-3256-4dd2-ad69-d2e89c0ca012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.445040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 773/1561] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:29.446190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.451741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d9c059e0-3256-4dd2-ad69-d2e89c0ca012 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.452928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d9c059e0-3256-4dd2-ad69-d2e89c0ca012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.456601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52396ba4-561e-4b33-9249-5dd6e44f8c0f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.461166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.461616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 789/1562] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.461863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.462182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.462522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.463240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.464929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.466462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:29.466580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.466756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.467033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.476115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 774/1563] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:29.479475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.488382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:29.488382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:29.489238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea0c7e60-b89e-4b93-b52a-7a3b6856554e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.493517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 790/1564] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:29.494243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.494960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.495678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.496063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.496433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.497360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:29.497674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.499324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.503794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f208561-61ba-495d-9526-8d9cb1693c7f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.508255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.508886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.509164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.509440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.510185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:29.510488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.512152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.512861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 775/1565] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:29.523869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.524330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8355548-fb47-4a2f-acc3-145b7b14a55a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.529708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 791/1566] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:29.529708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.536805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.538176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af5e850c-98b5-424c-9039-8961ae0ed824 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.538309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.538805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.539265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.540542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:29.540855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.542552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.543367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.544040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.544320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.544599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.548623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:29.548623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.548623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.555430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 776/1567] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:29.556138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.563752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 792/1568] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:29.565096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.568049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539ef341-0306-4dd0-b26c-bec284a6afa4 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.574191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.575069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.575457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.576012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] PATH_INFO: `/v3/projects/feee5b9c3ccd4349b2d5e8e4123537e3/users/025f5b30af784ca9a89657b7ded53662/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.580840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33b2cd6-91fd-4152-924b-48f27ba89815 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.585441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.586178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.586466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.586746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.587465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:29.587773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.589363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.591399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=feee5b9c3ccd4349b2d5e8e4123537e3, user_id=025f5b30af784ca9a89657b7ded53662, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.592892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:15:29.592892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:15:29.592892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:15:29.594881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.600757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 793/1569] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:29.601621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.606405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:29.611349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18d5200-494c-4526-b742-d963313f9b22 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.616475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.617114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.617400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.617947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.618706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.620319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.631170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 794/1570] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:29.631940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.641130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f789ae4a-1fb5-4718-8d3b-4befef9fa9f6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.646292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.646919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.647204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.647483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.648176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:29.648480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.650008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.661085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 795/1571] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:29.661836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.670790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-711a84ab-89f7-4e50-bd8f-4c9a37c08e84 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.675876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.676469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.677063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.677063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.677696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.679597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.697452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 777/1572] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:29 2022] PUT /identity/v3/projects/feee5b9c3ccd4349b2d5e8e4123537e3/users/025f5b30af784ca9a89657b7ded53662/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:29.698452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.758518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee7c76df-b51c-4c0c-9073-7dac10f395e8 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.762995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.763631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.763907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.764181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.764854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.766772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.778781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 796/1573] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/projects => generated 373 bytes in 117 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:29.790667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.843025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3e48f6a-4b81-489e-872e-bb8df93b4cf7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.848216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.848868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.849152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.849429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.850151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.852062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.865346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 778/1574] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/projects => generated 379 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:29.865346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:29.923873 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cce9faf1-c2ac-4ae3-b611-e53570c2db38 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:29.928956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:29.929653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:29.929942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:29.930249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:29.930939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:29.932858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:29.983954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 797/1575] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/projects => generated 385 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:29.984931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.010530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 779/1576] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/projects => generated 371 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.010530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.026766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:30.053469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ec4966-a44f-431e-b967-7ae83b8ea3e5 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.072748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac7b6b0d-63a1-4270-bd3c-be7254dea446 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.078579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.079532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.079822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.080098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] PATH_INFO: `/v3/projects/f9cce405a4ce4b889bd3deadc4b48790/users/63116783cc3f4f84a11027d5bfdab705/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.094496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] RBAC: Authorizing `identity:create_grant(project_id=f9cce405a4ce4b889bd3deadc4b48790, user_id=63116783cc3f4f84a11027d5bfdab705, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.097662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.099204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:30.110792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f6bf3b-9b36-41b9-b2d6-4c091fc22035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.112095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6bf3b-9b36-41b9-b2d6-4c091fc22035 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.112384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6bf3b-9b36-41b9-b2d6-4c091fc22035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.114146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f6bf3b-9b36-41b9-b2d6-4c091fc22035 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.114146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6bf3b-9b36-41b9-b2d6-4c091fc22035 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.115504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92f6bf3b-9b36-41b9-b2d6-4c091fc22035 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.199415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 780/1577] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:30 2022] PUT /identity/v3/projects/f9cce405a4ce4b889bd3deadc4b48790/users/63116783cc3f4f84a11027d5bfdab705/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:30.200213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.229724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 798/1578] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:29 2022] POST /identity/v3/projects => generated 391 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.231258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.231549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.231824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.257911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] MFA Rules not processed for user `025f5b30af784ca9a89657b7ded53662`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:30.259271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:30.261536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb9948b0-35e0-4d89-a400-aa64a51d9f1a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.317387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.318073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.318516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.318805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.319496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.321417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.322779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 799/1579] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:30.323398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.334308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cbbe4eb-874b-4f53-80be-7388d1c1b994 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.338919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.339568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.339851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.342150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.342150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.342150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:15:30.342150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:15:30.342150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:15:30.343051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.423587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 781/1580] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/projects => generated 385 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.425024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.437425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 800/1581] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 287 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.437425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.445229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5f5ed5-ca55-430a-8a14-ca37fbfc28f3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.457846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:30.487405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-096d63fc-ec5b-40a6-b9df-0288c2a29e34 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.493034 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.493697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.493978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.494275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.494961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.496937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.500502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-406a3a72-ca2c-4751-9ad9-79ce794697f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.502801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3a72-ca2c-4751-9ad9-79ce794697f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.502801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3a72-ca2c-4751-9ad9-79ce794697f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.502801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-406a3a72-ca2c-4751-9ad9-79ce794697f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.503111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a3a72-ca2c-4751-9ad9-79ce794697f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.505002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-406a3a72-ca2c-4751-9ad9-79ce794697f3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.585528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 782/1582] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.588817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.595698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ecbd914-c247-4e60-b7d9-e2fccfce7eed admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.600372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.601037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.601316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.601700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.602415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.605352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.612188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 801/1583] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 293 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.612188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.612188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.612188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.628964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:30.630180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:30.637707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 802/1584] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:30.638453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.647881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da0fde71-d9fd-449a-b8e1-6af18d9bf50e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.652438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.657298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.657298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.657298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.657298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.657298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.708195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 783/1585] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 286 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.708927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.718252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c1f4a38-471b-4aa7-97c7-ac4f7c856d16 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.722705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.723323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.723600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.723874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.724538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.726468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.737315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 803/1586] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 296 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.741354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.748461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffebfc4d-b48d-430d-b564-1ee12c79d872 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.753754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.754438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.754723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.755004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.755686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.757590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.765974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=88,keystone:INSERT=12 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:30.812104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 784/1587] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/projects => generated 373 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.813093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.834494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 804/1588] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:30.835525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.845155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b486fe5c-3da0-49dd-90b6-c9e31aadd1ce admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.875569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21efdc68-4cf0-42a2-809b-0e706e8f8552 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.880533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.881194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.881474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.881749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.882503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.884101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.894270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 785/1589] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:30.895168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.905342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3ec015-6d1d-4f17-a886-bccc531a3c7c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.907220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.907899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.908186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.908472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.909697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.910548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.911178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.911339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.911461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.911737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.912447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.913992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.923900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 805/1590] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:30.923900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.924135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 786/1591] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:30.924514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.936053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96ae0be0-5e11-4645-8f23-64a2be3bc30f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.940540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.941167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.941450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.941724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.942464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.944036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.954229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 787/1592] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:30.954993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.964133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c38e9083-5bdd-404b-bfca-10383176f6d5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.969304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.969948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.970269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.970557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.971298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.973413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.979135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63015a7f-17a0-403d-975b-3311f256c395 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.982736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.983161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 788/1593] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:30 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:30.986304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.986304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.986503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:30.986594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:30.993867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d210c75-be83-48db-a646-eeb729cdf5ea admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:30.994013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:30.995466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:30.998523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:30.999146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:30.999432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:30.999709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.000377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.002288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.004712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 806/1594] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:31.005485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.014435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96a362a2-4480-4f9f-8622-5fd4360a27ab service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.019795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.020418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.020704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.022138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.022138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.023316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.033587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 807/1595] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.034959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.044285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-501c73e0-c00e-4550-b5f6-4050c0947d7a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.048840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.049496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.049792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.050670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.051359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.052931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.062439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 808/1596] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.063191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.072354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3e85d9d-1aa7-4129-a297-1ede1777b937 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.077377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.077993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.078345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.078630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.079325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.083686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 789/1597] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:30 2022] POST /identity/v3/users => generated 293 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:31.083839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.083951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.091695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a15eaa88-acad-4ffc-9608-0bc30e05d76a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.093956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 809/1598] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.094892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.100179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.101038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.101537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.101977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.102738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.104389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.107196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccbb7b1c-9eb6-47a6-bd9e-3485920908aa admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.115984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.116651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.116934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.122400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.122400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.122600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 790/1599] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.122690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.122767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.135494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 810/1600] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.135705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ba3171-24bb-4ef0-8bed-1fdb8b5c7df7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.135794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.140291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.141114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.141392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.141794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.142676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.145170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.146455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1717c17-19cb-4772-9f0a-7cc08244db85 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.151192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.151858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.152145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.152577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.153303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.154936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.159978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 791/1601] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.161224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.166176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 811/1602] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.167059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.169253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:INSERT=10 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:31.173310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc361ef-8036-4656-b896-daca76f1d245 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.177891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79999afe-de1f-4ab1-b181-9326d6856ec6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.178222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.179133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.179543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.179819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] PATH_INFO: `/v3/projects/e077557746fe4ed7898c9a8a0d6dc8b2/users/e83f00453515416d94a7bc63363e2b4b/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.182765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.183986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.183986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.183986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.184712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.186497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.197830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e077557746fe4ed7898c9a8a0d6dc8b2, user_id=e83f00453515416d94a7bc63363e2b4b, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.200600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.200982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 812/1603] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:31 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:31.200982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.214313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-695e9bb7-9d90-46c9-8363-1a08bbbe1283 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.218922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.219787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.220072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.220349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] PATH_INFO: `/v3/projects/b2c0c79cfceb46319418afcbd9c01af4/users/53d4ddc721bf438d890c7dbae8d2b775/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.234915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2c0c79cfceb46319418afcbd9c01af4, user_id=53d4ddc721bf438d890c7dbae8d2b775, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.237587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.286178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 792/1604] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/e077557746fe4ed7898c9a8a0d6dc8b2/users/e83f00453515416d94a7bc63363e2b4b/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:31.287283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.312607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 813/1605] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/b2c0c79cfceb46319418afcbd9c01af4/users/53d4ddc721bf438d890c7dbae8d2b775/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 111 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:31.313651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.320878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=2,keystone:SELECT=98 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:31.367374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76af84fa-b6d8-49a0-a9b7-1c20b3435e4c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.391141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383fabd1-aa0d-4e63-a2bc-27aa980b7614 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.396633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.397525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.398240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.398240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] PATH_INFO: `/v3/projects/bad0f671b4a443b4b56b020770199188/users/99fcc40dba0b44cfa271ec3efd906982/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.416332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bad0f671b4a443b4b56b020770199188, user_id=99fcc40dba0b44cfa271ec3efd906982, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.423752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.426889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.427770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.428050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.428326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] PATH_INFO: `/v3/projects/c2441ca8e0154081868d5d9400c7b98c/users/164a47626c5c44508f2e701e6cecda96/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.442232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c2441ca8e0154081868d5d9400c7b98c, user_id=164a47626c5c44508f2e701e6cecda96, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.444893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.506870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 814/1606] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/bad0f671b4a443b4b56b020770199188/users/99fcc40dba0b44cfa271ec3efd906982/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:31.508441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.569163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 793/1607] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/c2441ca8e0154081868d5d9400c7b98c/users/164a47626c5c44508f2e701e6cecda96/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:31.580191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6291ea7-65be-4867-bd52-305f007fb255 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.581440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.645266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.646205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.646481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.646758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] PATH_INFO: `/v3/projects/abddabc35a004d6c82d0400aef1d6dac/users/c4815e3cdfc9485f8c8b0f1d0a0cc0cd/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.657995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b13e4d5-81b9-4bd0-9421-287428452502 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.662580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] RBAC: Authorizing `identity:create_grant(project_id=abddabc35a004d6c82d0400aef1d6dac, user_id=c4815e3cdfc9485f8c8b0f1d0a0cc0cd, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.668937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a72233-6a10-48d7-aa45-c9063aed6efc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.668937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a72233-6a10-48d7-aa45-c9063aed6efc admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.668937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a72233-6a10-48d7-aa45-c9063aed6efc admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.668937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a72233-6a10-48d7-aa45-c9063aed6efc admin admin] PATH_INFO: `/v3/projects/da331fc862d44b68b52cc0b7d91d9c92/users/9d3ca58b09634edc9e093d9d9eb0ee3f/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.669359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.680612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a72233-6a10-48d7-aa45-c9063aed6efc admin admin] RBAC: Authorizing `identity:create_grant(project_id=da331fc862d44b68b52cc0b7d91d9c92, user_id=9d3ca58b09634edc9e093d9d9eb0ee3f, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.683304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a72233-6a10-48d7-aa45-c9063aed6efc admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.685426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:31.763428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 815/1608] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/abddabc35a004d6c82d0400aef1d6dac/users/c4815e3cdfc9485f8c8b0f1d0a0cc0cd/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 256 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:31.765906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 794/1609] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/da331fc862d44b68b52cc0b7d91d9c92/users/9d3ca58b09634edc9e093d9d9eb0ee3f/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:31.767377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264862-8b65-4eaa-9e9b-6b88ee57c27a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.767667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264862-8b65-4eaa-9e9b-6b88ee57c27a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.767943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f264862-8b65-4eaa-9e9b-6b88ee57c27a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.771400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:31.790714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:31.797104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0f264862-8b65-4eaa-9e9b-6b88ee57c27a None None] MFA Rules not processed for user `e83f00453515416d94a7bc63363e2b4b`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:31.797993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0f264862-8b65-4eaa-9e9b-6b88ee57c27a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:31.836755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5966b99e-2b04-4a69-88ec-d23c7b4fd651 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:31.868581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 795/1610] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:31.880440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89fc7-6d24-4490-910f-586bf1978ffa None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.880736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89fc7-6d24-4490-910f-586bf1978ffa None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.881025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ea89fc7-6d24-4490-910f-586bf1978ffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.900210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-1ea89fc7-6d24-4490-910f-586bf1978ffa None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:31.901565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1ea89fc7-6d24-4490-910f-586bf1978ffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:31.905523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1b1b6a-aa36-4264-a353-50446c7a9c96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:31.906759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b1b6a-aa36-4264-a353-50446c7a9c96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.907048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b1b6a-aa36-4264-a353-50446c7a9c96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.907324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1b1b6a-aa36-4264-a353-50446c7a9c96 admin admin] PATH_INFO: `/v3/projects/89d5c61a1ad24327be0468632aa00ae5/users/aaaa8a52943f489792d11f296e696f6d/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.913528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 796/1611] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:31.914918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550323-95b6-4e07-877a-2ed58f2e080c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:31.915806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550323-95b6-4e07-877a-2ed58f2e080c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:31.915806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b550323-95b6-4e07-877a-2ed58f2e080c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:31.925912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b1b6a-aa36-4264-a353-50446c7a9c96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d5c61a1ad24327be0468632aa00ae5, user_id=aaaa8a52943f489792d11f296e696f6d, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:31.928933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1b1b6a-aa36-4264-a353-50446c7a9c96 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:31.942861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9b550323-95b6-4e07-877a-2ed58f2e080c None None] MFA Rules not processed for user `99fcc40dba0b44cfa271ec3efd906982`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:31.944150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9b550323-95b6-4e07-877a-2ed58f2e080c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.008081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 797/1612] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:31 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.009289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c138-6a15-4168-a568-adc42352def7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.009580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c138-6a15-4168-a568-adc42352def7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.009859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b1c138-6a15-4168-a568-adc42352def7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.015021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 816/1613] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:31 2022] PUT /identity/v3/projects/89d5c61a1ad24327be0468632aa00ae5/users/aaaa8a52943f489792d11f296e696f6d/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:32.016308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036aee-b8a3-4d22-b0bb-b225698327b7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.016597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036aee-b8a3-4d22-b0bb-b225698327b7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.016872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57036aee-b8a3-4d22-b0bb-b225698327b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.036562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-57036aee-b8a3-4d22-b0bb-b225698327b7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:32.037757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-57036aee-b8a3-4d22-b0bb-b225698327b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.043824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e4b1c138-6a15-4168-a568-adc42352def7 None None] MFA Rules not processed for user `164a47626c5c44508f2e701e6cecda96`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:32.045557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e4b1c138-6a15-4168-a568-adc42352def7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.108419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 817/1614] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.109737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.110165 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.110321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.121747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:32.129409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:32.130666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.132935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 798/1615] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.137390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e36af-2931-4b43-b237-8642e5713075 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.137857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e36af-2931-4b43-b237-8642e5713075 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.138313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-962e36af-2931-4b43-b237-8642e5713075 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.139428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 818/1616] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.140090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.143228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 799/1617] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 6 17:15:32 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:15:32.146416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e36af-2931-4b43-b237-8642e5713075 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.161701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-962e36af-2931-4b43-b237-8642e5713075 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.166795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.167412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.167737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.167975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.168686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.170717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.191444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:32.203780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f5a518a-0832-404a-8dfc-61f5a7e7239f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.207923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.208562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.208849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.209114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.217890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.219338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.229503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 819/1618] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:32.230237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.239314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2caa41-1cf6-4a7d-9ae2-8ceafcf2da07 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.245125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01265ddb-8914-48f4-8650-0b9121a5f706 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.245771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265ddb-8914-48f4-8650-0b9121a5f706 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.246075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265ddb-8914-48f4-8650-0b9121a5f706 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.246369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01265ddb-8914-48f4-8650-0b9121a5f706 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.247325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01265ddb-8914-48f4-8650-0b9121a5f706 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.249092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01265ddb-8914-48f4-8650-0b9121a5f706 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.258245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 800/1619] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/projects => generated 371 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:32.259399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.262583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 820/1620] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:32.262583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.262583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.262583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.279989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:32.281197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.319440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646c5db1-cd72-431a-8f3f-bdfca93c4889 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.323282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ede667a5-737e-426b-856f-f3a55dfd7a20 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.323958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede667a5-737e-426b-856f-f3a55dfd7a20 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.324202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede667a5-737e-426b-856f-f3a55dfd7a20 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.324483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede667a5-737e-426b-856f-f3a55dfd7a20 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.360164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 821/1621] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.361107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.363017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.381220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce5d58d7-83a0-4e38-ad71-ab481b309263 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.389830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.396362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.396362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.396362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.403032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede667a5-737e-426b-856f-f3a55dfd7a20 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.405182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ede667a5-737e-426b-856f-f3a55dfd7a20 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.420776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 801/1622] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:32.421613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.422009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e7dbd-f1b8-435b-9e4d-d8a8f756be0b None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.422321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e7dbd-f1b8-435b-9e4d-d8a8f756be0b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.422600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-137e7dbd-f1b8-435b-9e4d-d8a8f756be0b None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.423138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.429950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 802/1623] 10.222.0.20 () {54 vars in 961 bytes} [Wed Jul 6 17:15:32 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:15:32.431017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e7dbd-f1b8-435b-9e4d-d8a8f756be0b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.446807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 822/1624] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:32.447773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.448483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-137e7dbd-f1b8-435b-9e4d-d8a8f756be0b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.458109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b710f4-f6ef-44bd-a569-c8da7b3afaff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.459653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b710f4-f6ef-44bd-a569-c8da7b3afaff admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.460028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b710f4-f6ef-44bd-a569-c8da7b3afaff admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.460246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b710f4-f6ef-44bd-a569-c8da7b3afaff admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.461503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b710f4-f6ef-44bd-a569-c8da7b3afaff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.463724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b710f4-f6ef-44bd-a569-c8da7b3afaff admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.466666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d67b6f9-85fb-40e4-a1a6-ad12ab3cebdf service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.477668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.478616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.478903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.479184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] PATH_INFO: `/v3/projects/89d5c61a1ad24327be0468632aa00ae5/users/aaaa8a52943f489792d11f296e696f6d/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.481290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] RBAC: Authorizing `identity:create_grant(project_id=89d5c61a1ad24327be0468632aa00ae5, user_id=aaaa8a52943f489792d11f296e696f6d, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.484031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.495951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 823/1625] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:32 2022] PUT /identity/v3/projects/89d5c61a1ad24327be0468632aa00ae5/users/aaaa8a52943f489792d11f296e696f6d/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:32.497544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.572435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 803/1626] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/users => generated 292 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:32.572435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc663-551a-4ce0-acbd-227fdd8b0d49 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.572435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc663-551a-4ce0-acbd-227fdd8b0d49 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.572435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83fc663-551a-4ce0-acbd-227fdd8b0d49 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.583983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4ee024-d3f0-45d5-acc9-d23fb2923001 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.592534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.595007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.595352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.596017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.620507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b83fc663-551a-4ce0-acbd-227fdd8b0d49 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:32.620507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b83fc663-551a-4ce0-acbd-227fdd8b0d49 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.646198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 804/1627] 10.222.0.20 () {58 vars in 1058 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.647595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.649298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.649298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.674341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.677310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.708465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 824/1628] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:32.709770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] MFA Rules not processed for user `aaaa8a52943f489792d11f296e696f6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:32.710097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.711029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:32.725647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:32.809939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:32.862742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 805/1629] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:32 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:32.865284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:32.887009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec51679-f235-47ab-a3e5-f16b4a60d29e service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.900641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.902522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.902818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.903099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.903537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c69b1577-ed7d-463f-9d41-a5d084586747 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:32.905312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:32.908318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:32.920879 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ce621f-2489-4675-b2bb-5ec619d3a732 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:32.922812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce621f-2489-4675-b2bb-5ec619d3a732 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:32.922974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce621f-2489-4675-b2bb-5ec619d3a732 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:32.923267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ce621f-2489-4675-b2bb-5ec619d3a732 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:32.934840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 825/1630] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/roles => generated 1420 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:32.934840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:33.013585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d48b51d9-3ae3-4356-881d-630c857db3e9 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:33.019397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:33.020506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.021254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.021545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.041750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.043754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.049339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce621f-2489-4675-b2bb-5ec619d3a732 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.051097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ce621f-2489-4675-b2bb-5ec619d3a732 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.064281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 826/1631] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:33.070439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 806/1632] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 207 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:33.079080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:33.111461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-067bbd5e-173f-4709-8892-0204993f2d1e service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:33.129094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:33.131492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.131796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.134120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] PATH_INFO: `/v3/projects/9cf340f762164f349ac4ee10a2f5dc40/users/0c819ba1e26143b7901b3aa93c9b73fe/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.162363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf340f762164f349ac4ee10a2f5dc40, user_id=0c819ba1e26143b7901b3aa93c9b73fe, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.170996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.188057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a22306-b3ef-4b74-8f7a-39d0a7682a6c None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.188528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a22306-b3ef-4b74-8f7a-39d0a7682a6c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.188963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21a22306-b3ef-4b74-8f7a-39d0a7682a6c None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.192679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 807/1633] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 6 17:15:33 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Jul 06 17:15:33.200869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.204688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.204688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.229671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:33.231486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:33.250872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 808/1634] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:33.271395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:33.273037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 827/1635] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:33 2022] PUT /identity/v3/projects/9cf340f762164f349ac4ee10a2f5dc40/users/0c819ba1e26143b7901b3aa93c9b73fe/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:33.276925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:33.283173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67c543f-815d-46f4-8931-74a666f70bf3 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:33.416770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:33.420844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9f62c9b-9aa3-482a-a92c-d8d3c9c91d81 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:33.422650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62c9b-9aa3-482a-a92c-d8d3c9c91d81 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.424416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62c9b-9aa3-482a-a92c-d8d3c9c91d81 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.425466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9f62c9b-9aa3-482a-a92c-d8d3c9c91d81 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.444611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c189b7d-d9fd-4d49-aa10-a2c03513311a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:33.460210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:33.460887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.461171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.462078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.463027 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.467261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.490227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 828/1636] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:33 2022] GET /identity/v3/roles => generated 1420 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:33.497241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:33.525901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73e4172e-c77b-405d-b712-f3a1ece722fb admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:33.544427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d06997db-7e6a-48bf-87df-c7621d690d1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:33.548838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06997db-7e6a-48bf-87df-c7621d690d1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.549408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06997db-7e6a-48bf-87df-c7621d690d1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.552095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d06997db-7e6a-48bf-87df-c7621d690d1b admin admin] PATH_INFO: `/v3/projects/9cf340f762164f349ac4ee10a2f5dc40/users/0c819ba1e26143b7901b3aa93c9b73fe/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.556702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06997db-7e6a-48bf-87df-c7621d690d1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=9cf340f762164f349ac4ee10a2f5dc40, user_id=0c819ba1e26143b7901b3aa93c9b73fe, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.564162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d06997db-7e6a-48bf-87df-c7621d690d1b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.576575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f62c9b-9aa3-482a-a92c-d8d3c9c91d81 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.578275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9f62c9b-9aa3-482a-a92c-d8d3c9c91d81 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.586314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 829/1637] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:33 2022] PUT /identity/v3/projects/9cf340f762164f349ac4ee10a2f5dc40/users/0c819ba1e26143b7901b3aa93c9b73fe/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:33.588589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde929f-9046-49dc-a0dd-490b6796b55a None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.588960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde929f-9046-49dc-a0dd-490b6796b55a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.589312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bde929f-9046-49dc-a0dd-490b6796b55a None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.591092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 830/1638] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 6 17:15:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:15:33.595508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.596050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.599080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.602882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 809/1639] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 336 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:15:33.606442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.606740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.607031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.638288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] MFA Rules not processed for user `0c819ba1e26143b7901b3aa93c9b73fe`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:33.638536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:33.639669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:33.639792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:33.657705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:33.767667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 810/1640] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:33.798880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 831/1641] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:33 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:33.811877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:33.909895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5f0b967-a6bb-465b-82ee-01477b3f6f22 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:33.915253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:33.916003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:33.916360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:33.916706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:33.931833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:33.933908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:33.951561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 811/1642] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:35.004322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:35.051034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101af86-2d57-4478-bd95-d02cc0517939 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:35.064824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:35.064824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:35.064824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:35.071195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:35.116332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:35.118963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:35.141685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 832/1643] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:35 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:35.560655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:35.569169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216ef7a6-58bc-43f4-b6b3-71208fc08188 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:35.579769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8c080d-b783-47f0-8e10-bfee8b1efc39 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:35.580436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c080d-b783-47f0-8e10-bfee8b1efc39 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:35.580716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c080d-b783-47f0-8e10-bfee8b1efc39 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:35.581039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8c080d-b783-47f0-8e10-bfee8b1efc39 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:36.001157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c080d-b783-47f0-8e10-bfee8b1efc39 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:36.001157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8c080d-b783-47f0-8e10-bfee8b1efc39 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:36.001157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 812/1644] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:35 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:36.176206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:36.251496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0b3260-d428-4e2a-ae2e-431b2ed9fab3 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:36.257252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:36.264043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:36.264043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:36.264043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] PATH_INFO: `/v3/users/025f5b30af784ca9a89657b7ded53662` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:36.264043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] RBAC: Authorizing `identity:delete_user(user_id=025f5b30af784ca9a89657b7ded53662)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:36.264043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:36.583357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:INSERT=1,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:36.590339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '025f5b30af784ca9a89657b7ded53662'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:36.619757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '025f5b30af784ca9a89657b7ded53662'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:36.654855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '025f5b30af784ca9a89657b7ded53662'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:36.655854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '025f5b30af784ca9a89657b7ded53662'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:36.772442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '025f5b30af784ca9a89657b7ded53662'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:36.783565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 833/1645] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:15:36 2022] DELETE /identity/v3/users/025f5b30af784ca9a89657b7ded53662 => generated 0 bytes in 605 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:36.785875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:36.786566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:36.786566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:36.820622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:36.823363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:36.934540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:36.959748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 813/1646] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:36.988523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:36.990022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:37.133560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0688-a627-4600-b30a-c4b74531c18d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:37.148073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4f956fa-4342-41d7-8bab-2745ad1aab85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:37.149289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f956fa-4342-41d7-8bab-2745ad1aab85 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:37.155971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f956fa-4342-41d7-8bab-2745ad1aab85 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:37.155971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4f956fa-4342-41d7-8bab-2745ad1aab85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:37.168392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f956fa-4342-41d7-8bab-2745ad1aab85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:37.170144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4f956fa-4342-41d7-8bab-2745ad1aab85 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:37.190137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 834/1647] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:38.237634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:38.239235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:38.253835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3b1ab0-e264-4502-b9b7-b006904de961 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:38.260207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:38.261558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:38.261989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:38.262453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] PATH_INFO: `/v3/users/e83f00453515416d94a7bc63363e2b4b` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:38.264440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e83f00453515416d94a7bc63363e2b4b)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:38.265951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: WARNING py.warnings [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:15:38.265951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: warnings.warn(msg) Jul 06 17:15:38.265951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: Jul 06 17:15:38.267744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:38.564492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e83f00453515416d94a7bc63363e2b4b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:38.595932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e83f00453515416d94a7bc63363e2b4b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:38.641884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e83f00453515416d94a7bc63363e2b4b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:38.642776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e83f00453515416d94a7bc63363e2b4b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:38.761016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e83f00453515416d94a7bc63363e2b4b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:38.770010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 814/1648] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:15:38 2022] DELETE /identity/v3/users/e83f00453515416d94a7bc63363e2b4b => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:38.775275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:38.775768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:38.775853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:38.808654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:38.810120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:39.211867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 835/1649] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 438 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:39.238556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:39.240498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:39.364150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:39.365891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:39.393430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7ec6842-fa8d-4dc6-81a0-264b53d1ca67 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:39.410821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:39.412281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:39.412703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:39.413125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] PATH_INFO: `/v3/projects/feee5b9c3ccd4349b2d5e8e4123537e3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:39.415001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] RBAC: Authorizing `identity:delete_project(project_id=feee5b9c3ccd4349b2d5e8e4123537e3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:39.416582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: WARNING py.warnings [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Jul 06 17:15:39.416582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: warnings.warn(msg) Jul 06 17:15:39.416582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: Jul 06 17:15:39.421187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8d62c-6a2b-46d9-872a-c3dffd77820c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:39.429480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:39.429618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:39.430220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:39.430629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:39.430919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:39.459165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:39.460933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:39.476859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 815/1650] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:39.610808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'feee5b9c3ccd4349b2d5e8e4123537e3', 'request_id': 'req-08ecd957-1d6b-45be-a75d-0206bc8493dc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:39.621006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'feee5b9c3ccd4349b2d5e8e4123537e3', 'request_id': 'req-08ecd957-1d6b-45be-a75d-0206bc8493dc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:39.634440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:39.647593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'feee5b9c3ccd4349b2d5e8e4123537e3', 'request_id': 'req-08ecd957-1d6b-45be-a75d-0206bc8493dc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:39.749686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] The token cache is being invalidate because project feee5b9c3ccd4349b2d5e8e4123537e3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:15:39.750545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:39.752002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:39.769507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:39.776060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 836/1651] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:15:39 2022] DELETE /identity/v3/projects/feee5b9c3ccd4349b2d5e8e4123537e3 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:15:39.793596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be6632a-a1c7-40a0-a306-8946c5d5f87e service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:39.972771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:39.975869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:39.976649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:39.977239 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] PATH_INFO: `/v3/users/aaaa8a52943f489792d11f296e696f6d` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:39.979186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] RBAC: Authorizing `identity:delete_user(user_id=aaaa8a52943f489792d11f296e696f6d)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:39.982859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:40.001314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:40.205739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'aaaa8a52943f489792d11f296e696f6d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:40.242977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'aaaa8a52943f489792d11f296e696f6d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:40.273882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'aaaa8a52943f489792d11f296e696f6d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:40.275738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'aaaa8a52943f489792d11f296e696f6d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:40.371220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'aaaa8a52943f489792d11f296e696f6d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:40.381891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 816/1652] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:15:39 2022] DELETE /identity/v3/users/aaaa8a52943f489792d11f296e696f6d => generated 0 bytes in 612 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:15:42.229249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:42.230967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:42.260682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08ecd957-1d6b-45be-a75d-0206bc8493dc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:42.338191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:42.339384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:42.339892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:42.340502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] PATH_INFO: `/v3/users/164a47626c5c44508f2e701e6cecda96` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:42.341929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=164a47626c5c44508f2e701e6cecda96)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:42.344143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:42.455952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:42.457579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:42.496833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc1b7fa-dbf6-4f98-97ff-0c0508902057 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:42.515657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:42.519559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:42.519938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:42.520114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] PATH_INFO: `/v3/projects/e077557746fe4ed7898c9a8a0d6dc8b2` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:42.523254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e077557746fe4ed7898c9a8a0d6dc8b2)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:42.534557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:42.559799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '164a47626c5c44508f2e701e6cecda96'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.584743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '164a47626c5c44508f2e701e6cecda96'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.602926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '164a47626c5c44508f2e701e6cecda96'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.605311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '164a47626c5c44508f2e701e6cecda96'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.685193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bdc3d43a-5638-4994-bc30-043ff0d13e5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '164a47626c5c44508f2e701e6cecda96'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.692850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 837/1653] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:15:42 2022] DELETE /identity/v3/users/164a47626c5c44508f2e701e6cecda96 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:42.697670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:42.698371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:42.698812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:42.739123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:42.740608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:42.764839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e077557746fe4ed7898c9a8a0d6dc8b2', 'request_id': 'req-4ee44d00-007d-47fc-8437-856957880a29'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.791424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e077557746fe4ed7898c9a8a0d6dc8b2', 'request_id': 'req-4ee44d00-007d-47fc-8437-856957880a29'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.806475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e077557746fe4ed7898c9a8a0d6dc8b2', 'request_id': 'req-4ee44d00-007d-47fc-8437-856957880a29'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.872488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 838/1654] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:42.873893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:42.876808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:42.898391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ed554a-327d-4df4-a8da-c8c3a84316a6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:42.901293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] The token cache is being invalidate because project e077557746fe4ed7898c9a8a0d6dc8b2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:15:42.901534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.903004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:42.909903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 817/1655] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:15:42 2022] DELETE /identity/v3/projects/e077557746fe4ed7898c9a8a0d6dc8b2 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:42.909903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:42.912863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:42.921696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:42.923456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:42.925467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:42.925899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] PATH_INFO: `/v3/projects/89d5c61a1ad24327be0468632aa00ae5` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:42.927675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=89d5c61a1ad24327be0468632aa00ae5)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:42.929993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:42.933558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:43.052965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee44d00-007d-47fc-8437-856957880a29 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:43.064456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:43.068834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.068834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.068834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.070256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:43.094242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:43.098587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f46548-52aa-4c89-b887-a20172270567 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:43.125388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 818/1656] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:43.126882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971965e-68f9-4ecb-8f81-d5d4e85e32ba None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.127256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971965e-68f9-4ecb-8f81-d5d4e85e32ba None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.127538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a971965e-68f9-4ecb-8f81-d5d4e85e32ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.156896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '89d5c61a1ad24327be0468632aa00ae5', 'request_id': 'req-ca8ff24d-b74c-4037-b145-8e623c3f73a3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:43.168857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-a971965e-68f9-4ecb-8f81-d5d4e85e32ba None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:43.169562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '89d5c61a1ad24327be0468632aa00ae5', 'request_id': 'req-ca8ff24d-b74c-4037-b145-8e623c3f73a3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:43.172100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a971965e-68f9-4ecb-8f81-d5d4e85e32ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:43.187684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '89d5c61a1ad24327be0468632aa00ae5', 'request_id': 'req-ca8ff24d-b74c-4037-b145-8e623c3f73a3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:43.189822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:43.308520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] The token cache is being invalidate because project 89d5c61a1ad24327be0468632aa00ae5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:15:43.309605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:43.311199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca8ff24d-b74c-4037-b145-8e623c3f73a3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:43.315032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 839/1657] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:15:42 2022] DELETE /identity/v3/projects/89d5c61a1ad24327be0468632aa00ae5 => generated 0 bytes in 442 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:43.320037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c0fd-a14d-4840-bb8e-e5004a6afa8c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.320554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c0fd-a14d-4840-bb8e-e5004a6afa8c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.321052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9657c0fd-a14d-4840-bb8e-e5004a6afa8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.321427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 819/1658] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:43.329750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b013d-c353-455f-9f9e-358242374009 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.336356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b013d-c353-455f-9f9e-358242374009 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.336356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161b013d-c353-455f-9f9e-358242374009 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.383368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9657c0fd-a14d-4840-bb8e-e5004a6afa8c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:43.385164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9657c0fd-a14d-4840-bb8e-e5004a6afa8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:43.395298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-161b013d-c353-455f-9f9e-358242374009 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:43.396842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-161b013d-c353-455f-9f9e-358242374009 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:43.414284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 840/1659] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:43.416088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.416358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.416646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.431068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 820/1660] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:43.436018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b013d-c353-455f-9f9e-358242374009 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:43.453995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161b013d-c353-455f-9f9e-358242374009 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:43.461235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:43.467835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:43.469265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.469897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.470391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:43.470858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.472393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:43.473946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:43.476389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:43.498496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 841/1661] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:43.503255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:43.504461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 821/1662] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:43.519480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:43.523853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-611e07b4-4f67-4f59-a0e8-67bbfc0bfbf0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:43.556523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:43.557462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a939c1b-b6a7-44c1-95c7-8f892b4bcfff admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:43.557634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.557828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.558290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.559376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:43.560076 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:43.563551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:43.566012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:43.568379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.568843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.569278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.573383 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:43.575683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:43.604043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 842/1663] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:15:43.604975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:43.634369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22b6aace-db8d-4e8e-9b37-f8773633a0c4 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:43.649269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:43.650010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:43.651654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:43.652267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:43.654078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:43.660308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:43.770978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 822/1664] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/projects => generated 365 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:15:43.776392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:43.832994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 843/1665] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/projects => generated 355 bytes in 228 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:43.837215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:43.939746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361ffe9-4f8b-44e8-977a-d89b41e7ac31 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.015360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79250cbe-9385-4f36-b90d-c717bd75c615 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.029832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.030655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.031007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.031350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.032130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.035074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.111931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.112829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.113115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.113387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.114150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.118591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.156572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 844/1666] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/users => generated 278 bytes in 320 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:44.161028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:44.179492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6933a6b7-0ae0-4739-9f12-ad642aa4e4f1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.189171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.189886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.190239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.190522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.191369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.193166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.228672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 845/1667] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:15:44.232544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:44.256210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ec0c857-26a7-40db-b718-b40c8c58437b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.273349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 823/1668] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:43 2022] POST /identity/v3/users => generated 283 bytes in 495 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:44.275551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:44.291530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.292388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.293767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.295975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.298779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.305446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.310810 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a60921-1987-4468-91b1-611a9e7442a2 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.330747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.332142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.333681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.334056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.334949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.340150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.343508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 846/1669] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 111 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:44.348003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:44.366526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 824/1670] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:44.368662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc1ef29-b260-4cde-8088-ab7b9b3ca575 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.374156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:44.381817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-435fa56d-6ff9-488a-8dc3-85a53e4622d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.382746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fa56d-6ff9-488a-8dc3-85a53e4622d9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.383028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fa56d-6ff9-488a-8dc3-85a53e4622d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.383304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-435fa56d-6ff9-488a-8dc3-85a53e4622d9 admin admin] PATH_INFO: `/v3/projects/4350c1251ed6429fafa7b042a6b6fbad/users/0d974c99b6e74835beabd0863b95bdf2/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.387930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d1abc21-cca4-4ac8-b6f0-28fc58beec50 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.400094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=88,keystone:DELETE=7,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:44.402664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.405491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.405903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.407866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.411929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.416641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.423160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fa56d-6ff9-488a-8dc3-85a53e4622d9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4350c1251ed6429fafa7b042a6b6fbad, user_id=0d974c99b6e74835beabd0863b95bdf2, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.426570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-435fa56d-6ff9-488a-8dc3-85a53e4622d9 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.447865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 825/1671] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:44 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:44.461167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:44.485191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4436055c-109c-45e0-8c03-e3a10b80d7ab admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:44.492111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f135c244-7c4d-4457-8b3c-fd19cea11371 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:44.494153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135c244-7c4d-4457-8b3c-fd19cea11371 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.494578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135c244-7c4d-4457-8b3c-fd19cea11371 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.496119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f135c244-7c4d-4457-8b3c-fd19cea11371 admin admin] PATH_INFO: `/v3/projects/499e00f27e03468a8ca99f17a2fa8466/users/851047e9092445e9b2fa669362f88dcc/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.524163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135c244-7c4d-4457-8b3c-fd19cea11371 admin admin] RBAC: Authorizing `identity:create_grant(project_id=499e00f27e03468a8ca99f17a2fa8466, user_id=851047e9092445e9b2fa669362f88dcc, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:44.526095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f135c244-7c4d-4457-8b3c-fd19cea11371 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:44.554897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 847/1672] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:44 2022] PUT /identity/v3/projects/4350c1251ed6429fafa7b042a6b6fbad/users/0d974c99b6e74835beabd0863b95bdf2/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:44.566773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.567342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.567767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.666146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:44.666781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] MFA Rules not processed for user `0d974c99b6e74835beabd0863b95bdf2`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:44.670625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:44.672157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 826/1673] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:44 2022] PUT /identity/v3/projects/499e00f27e03468a8ca99f17a2fa8466/users/851047e9092445e9b2fa669362f88dcc/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:44.684862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:44.685238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:44.685590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:44.787556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] MFA Rules not processed for user `851047e9092445e9b2fa669362f88dcc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:44.790451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:44.901620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 848/1674] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:44 2022] POST /identity/v3/auth/tokens => generated 3222 bytes in 336 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:44.902600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:45.005469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 827/1675] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:44 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 322 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:45.020115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:45.021985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:45.151435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a667e90-cd48-46f3-bd8e-4fedaeeaf57a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:45.158452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:45.159171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.159550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.160320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.161711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:45.164915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:45.200377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37839d7f-d7cc-4c97-8e9e-7eb3d10c6ee7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:45.219271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:45.219693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.219967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.223711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.257462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:45.259366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:45.267657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 849/1676] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:44 2022] POST /identity/v3/projects => generated 353 bytes in 363 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:45.270358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:45.302328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 828/1677] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:45 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 282 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:45.417580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faf52736-d34a-4f3a-8eda-b1649dd49499 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:45.427216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:45.427919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.428325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.433644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.433644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:45.433644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:45.564028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 850/1678] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:45 2022] POST /identity/v3/users => generated 283 bytes in 294 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:45.568727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:45.588486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b71c65c3-7798-4532-91a5-7f8b1f489fdd service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:45.601485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:45.613931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.614673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.615155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.616138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:45.618721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:45.650693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 829/1679] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:45 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:15:45.654175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:45.676206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e7ebb0-cbf0-4e2d-8f93-4963786d145d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:45.693228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06f559d3-18b5-44e4-ad02-c921b5fcb3f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:45.693354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f559d3-18b5-44e4-ad02-c921b5fcb3f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.693778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f559d3-18b5-44e4-ad02-c921b5fcb3f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.694434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f559d3-18b5-44e4-ad02-c921b5fcb3f4 admin admin] PATH_INFO: `/v3/projects/5467da5f36434e2ca4da14c401cb88fe/users/56dd31506d224e5dbf0cad447885f871/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.765266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f559d3-18b5-44e4-ad02-c921b5fcb3f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5467da5f36434e2ca4da14c401cb88fe, user_id=56dd31506d224e5dbf0cad447885f871, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:45.778629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:45.778629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:45.779359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06f559d3-18b5-44e4-ad02-c921b5fcb3f4 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:45.803304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d463dce-39b4-4e0d-8b8c-856feca5fc93 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:45.815874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:45.821646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.822275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.823654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] PATH_INFO: `/v3/projects/c2441ca8e0154081868d5d9400c7b98c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.839755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c2441ca8e0154081868d5d9400c7b98c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:45.847541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:45.903659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 851/1680] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:45 2022] PUT /identity/v3/projects/5467da5f36434e2ca4da14c401cb88fe/users/56dd31506d224e5dbf0cad447885f871/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:45.905883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ee02-a554-4bc4-bfff-7050cfe8d481 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:45.906466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ee02-a554-4bc4-bfff-7050cfe8d481 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:45.906924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3ee02-a554-4bc4-bfff-7050cfe8d481 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:45.992068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d7a3ee02-a554-4bc4-bfff-7050cfe8d481 None None] MFA Rules not processed for user `63116783cc3f4f84a11027d5bfdab705`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:45.993918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d7a3ee02-a554-4bc4-bfff-7050cfe8d481 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.054886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c2441ca8e0154081868d5d9400c7b98c', 'request_id': 'req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:46.070766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c2441ca8e0154081868d5d9400c7b98c', 'request_id': 'req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:46.097046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c2441ca8e0154081868d5d9400c7b98c', 'request_id': 'req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:46.139119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 852/1681] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:45 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:46.153052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.153483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.153837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.186173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:46.191598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] MFA Rules not processed for user `53d4ddc721bf438d890c7dbae8d2b775`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:46.193296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.213604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] The token cache is being invalidate because project c2441ca8e0154081868d5d9400c7b98c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:15:46.213895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:46.222312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:15:46.240418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 830/1682] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:15:45 2022] DELETE /identity/v3/projects/c2441ca8e0154081868d5d9400c7b98c => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:15:46.241435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:46.243158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.348402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 853/1683] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:46.350214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:46.352241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.388322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6597e4-5287-4c8b-a314-65cc1cfd4b62 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:46.402824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08640953-980a-4848-a1c2-000cf598a803 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:46.403646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08640953-980a-4848-a1c2-000cf598a803 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.403930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08640953-980a-4848-a1c2-000cf598a803 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.404219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08640953-980a-4848-a1c2-000cf598a803 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.404962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08640953-980a-4848-a1c2-000cf598a803 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:46.406626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08640953-980a-4848-a1c2-000cf598a803 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:46.441264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 831/1684] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:46 2022] GET /identity/v3/roles => generated 1420 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:46.442805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba606f-9ef3-41e4-a699-6b6887d12140 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.443103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba606f-9ef3-41e4-a699-6b6887d12140 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.443386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ba606f-9ef3-41e4-a699-6b6887d12140 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.487437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-45ba606f-9ef3-41e4-a699-6b6887d12140 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:46.488679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-45ba606f-9ef3-41e4-a699-6b6887d12140 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.506598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 832/1685] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:46.507937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.508232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.508516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.553456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] MFA Rules not processed for user `53d4ddc721bf438d890c7dbae8d2b775`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:46.555377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.569780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794c5402-23a2-4ee7-85c8-3f487ca95919 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:46.588434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 833/1686] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:46.589493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:46.597163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:46.603657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:46.604307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.607553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.607867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.613987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b88d04-2e14-4d49-a822-75fad030e353 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:46.615175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.626291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e163896f-1173-4b1e-a273-c0f03116ece8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:46.628572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163896f-1173-4b1e-a273-c0f03116ece8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.630171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163896f-1173-4b1e-a273-c0f03116ece8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.630668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e163896f-1173-4b1e-a273-c0f03116ece8 admin admin] PATH_INFO: `/v3/projects/5467da5f36434e2ca4da14c401cb88fe/users/56dd31506d224e5dbf0cad447885f871/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.636945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163896f-1173-4b1e-a273-c0f03116ece8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5467da5f36434e2ca4da14c401cb88fe, user_id=56dd31506d224e5dbf0cad447885f871, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:46.641321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e163896f-1173-4b1e-a273-c0f03116ece8 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:46.660998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 834/1687] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:46 2022] PUT /identity/v3/projects/5467da5f36434e2ca4da14c401cb88fe/users/56dd31506d224e5dbf0cad447885f871/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 72 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:46.662674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211c3c-db17-4f10-8afe-eb496dd8ebc0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.663122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211c3c-db17-4f10-8afe-eb496dd8ebc0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.663762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca211c3c-db17-4f10-8afe-eb496dd8ebc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:46.711340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ca211c3c-db17-4f10-8afe-eb496dd8ebc0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:46.717617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ca211c3c-db17-4f10-8afe-eb496dd8ebc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.798224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:46.801431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:46.825691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 854/1688] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:46 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 475 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:46.826114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:46.838620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:46.889858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd5b04c-f55f-47e5-b445-28936f6e3f5e service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:46.913594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 835/1689] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:46.917577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:46.920738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:46.920910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:47.040400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] MFA Rules not processed for user `56dd31506d224e5dbf0cad447885f871`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:47.041642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:47.162272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:47.166892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:47.166892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:47.166892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:47.215733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 836/1690] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:46 2022] POST /identity/v3/auth/tokens => generated 3287 bytes in 296 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:47.215733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:47.247217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3d0942-fc11-44f6-a3d9-9503efb1380a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:47.256910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:47.257733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:47.258175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:47.258652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:47.259593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:15:47.260002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:47.262106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:47.282246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 837/1691] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:15:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:15:47.282246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:47.285513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:47.465306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:47.469319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:47.576660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 855/1692] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:46 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 751 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:47.579926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:47.620352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1d5ef-ef33-4f02-9f63-914f6316f25e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:47.635659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a065b8-b541-4c29-b19f-09c591c612d4 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:47.636933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:47.640546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:47.641469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:47.661904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:47.662274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab0f2d0c-3bfc-42be-a77d-f8a90c5746d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:47.662274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2d0c-3bfc-42be-a77d-f8a90c5746d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:47.662274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2d0c-3bfc-42be-a77d-f8a90c5746d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:47.662274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab0f2d0c-3bfc-42be-a77d-f8a90c5746d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:47.663493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f2d0c-3bfc-42be-a77d-f8a90c5746d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:47.665963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab0f2d0c-3bfc-42be-a77d-f8a90c5746d2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:47.682790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:47.692125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:47.730177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 838/1693] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:47 2022] GET /identity/v3/auth/tokens => generated 3287 bytes in 448 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:47.829155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:47.841118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 856/1694] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:47 2022] POST /identity/v3/projects => generated 367 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:47.861576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de1c2eb2-1925-4f21-a718-9b53c9bcf68c service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:48.046797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:48.048245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.048649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.049205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.050122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:48.056630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:48.142724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.143021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.143855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.199869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 839/1695] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:47 2022] POST /identity/v3/users => generated 284 bytes in 369 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:48.202926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:48.246085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:48.247047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fff753d4-ff41-45c0-8022-d90e84367117 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:48.261362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:48.262477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.262923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.263332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.264201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:48.266690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:48.282319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] MFA Rules not processed for user `c4815e3cdfc9485f8c8b0f1d0a0cc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:48.292132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 840/1696] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:48.292132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:48.292394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:48.415206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf8fcd4-26db-4b08-9c89-c358c8e72667 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:48.423538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=94,keystone:DELETE=4,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:48.425476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:48.426175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.446121 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.446590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.448888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:48.538703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 857/1697] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 397 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:48.539949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:48.584268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb6443a0-f84c-4a90-b512-80f3bb79a14e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:48.593308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:48.595466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cf732f-1967-4a79-9e0e-a3ab51b8a95f service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:48.606493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:48.607097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 841/1698] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:48 2022] GET /identity/v3/auth/tokens => generated 3222 bytes in 317 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:48.608841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.609335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.609795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.615980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.620079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.622273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.629590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:48.634139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] MFA Rules not processed for user `c4815e3cdfc9485f8c8b0f1d0a0cc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:48.636201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:48.637250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:48.652719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 842/1699] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:48 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:48.678657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:48.697530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 858/1700] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:48 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:48.699228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:48.749834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c3ca72-0825-463b-9842-d3daf810b7c1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:48.778910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beec699f-ff75-47bf-979f-615a26292599 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:48.780281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec699f-ff75-47bf-979f-615a26292599 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.783015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec699f-ff75-47bf-979f-615a26292599 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.783481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beec699f-ff75-47bf-979f-615a26292599 admin admin] PATH_INFO: `/v3/projects/5afeb43e77244fd0bc04136802c50169/users/90f1f5ad75244038b979fc85a5e710f3/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.801587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d804b82-f879-4cd4-a166-6f7c857a4da5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:48.808950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b56b85-d98b-481a-835d-802fadaa3524 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:48.809838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b56b85-d98b-481a-835d-802fadaa3524 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.810456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b56b85-d98b-481a-835d-802fadaa3524 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.810920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b56b85-d98b-481a-835d-802fadaa3524 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:48.821551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b56b85-d98b-481a-835d-802fadaa3524 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:48.824611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b56b85-d98b-481a-835d-802fadaa3524 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:48.836998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 843/1701] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:48 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:48.854157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec699f-ff75-47bf-979f-615a26292599 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5afeb43e77244fd0bc04136802c50169, user_id=90f1f5ad75244038b979fc85a5e710f3, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:48.863237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beec699f-ff75-47bf-979f-615a26292599 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:48.973421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:48.973720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:48.974002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.024138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 859/1702] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:48 2022] PUT /identity/v3/projects/5afeb43e77244fd0bc04136802c50169/users/90f1f5ad75244038b979fc85a5e710f3/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:49.035198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc4e8-0a13-4191-a668-5d50ce12b3ed None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.035491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc4e8-0a13-4191-a668-5d50ce12b3ed None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.035773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9bfc4e8-0a13-4191-a668-5d50ce12b3ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.035964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] MFA Rules not processed for user `9d3ca58b09634edc9e093d9d9eb0ee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:49.037695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:49.111678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c9bfc4e8-0a13-4191-a668-5d50ce12b3ed None None] MFA Rules not processed for user `90f1f5ad75244038b979fc85a5e710f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:49.113623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c9bfc4e8-0a13-4191-a668-5d50ce12b3ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:49.169711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 844/1703] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 197 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:49.270423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 860/1704] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:49.279578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:49.359473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032c81-d0a9-4561-9542-e46a1e125a29 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.359771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032c81-d0a9-4561-9542-e46a1e125a29 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.360109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95032c81-d0a9-4561-9542-e46a1e125a29 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.362721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 861/1705] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 6 17:15:49 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:15:49.380616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.381160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.381634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.490071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:49.491710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:49.514902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e3d6ca-306a-4c20-beab-771dfba3646b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:49.520634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a137fbd7-0d0b-4949-934e-ee2f252310b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:49.521438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137fbd7-0d0b-4949-934e-ee2f252310b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.521786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137fbd7-0d0b-4949-934e-ee2f252310b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.522109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a137fbd7-0d0b-4949-934e-ee2f252310b0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.522813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137fbd7-0d0b-4949-934e-ee2f252310b0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:49.525094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a137fbd7-0d0b-4949-934e-ee2f252310b0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:49.584672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 862/1706] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:49.597241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:49.598780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:49.615099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41006f59-ab2d-49e1-96c8-d85699f466b4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:49.620542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:49.621478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.622214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.622749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.636991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:49.642624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:49.653722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 863/1707] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:15:49.695377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 845/1708] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:15:49 2022] POST /identity/v3/projects => generated 369 bytes in 416 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:15:49.699111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:49.712086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a5270d7-0dd7-42cd-aef6-4e32f18f9b98 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:49.713467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41aa2-7ef5-4afe-8563-53f1321fc6ff None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.715119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41aa2-7ef5-4afe-8563-53f1321fc6ff None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.715410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe41aa2-7ef5-4afe-8563-53f1321fc6ff None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.720855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 846/1709] 10.222.0.20 () {54 vars in 912 bytes} [Wed Jul 6 17:15:49 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:15:49.729349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.729944 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.730601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.757572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:49.759906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:49.824579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:49.833024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:49.833719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.834129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.834408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.835324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:49.837427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:49.887228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 847/1710] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:15:49 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:49.901639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:49.904591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:49.917555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf1a8ac-8877-4f56-b17a-ce8a9c6f51df None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:49.924342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:49.925032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:49.929589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:49.929589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:49.933673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:49.935149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:49.943403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 848/1711] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:49 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:15:49.981167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 864/1712] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:15:49 2022] POST /identity/v3/users => generated 291 bytes in 283 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:15:49.987957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:50.019756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17eadc5b-0cfb-4bd2-bd6d-d5bd75c39196 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:50.036512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:50.039511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.039511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.039511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.039511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:50.040245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:50.064688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 849/1713] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:49 2022] GET /identity/v3/roles => generated 1420 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:50.064813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:50.082410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa6e9ec5-928e-4040-9b19-85afb86f5149 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:50.090641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:50.091633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.091917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.092282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] PATH_INFO: `/v3/projects/73ba4ff73f75464ea29bb1fa5d1f216e/users/6200fa9ff5cd446893fa55d98e7cdf8a/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.111692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba4ff73f75464ea29bb1fa5d1f216e, user_id=6200fa9ff5cd446893fa55d98e7cdf8a, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:50.113580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:50.206276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 865/1714] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:50 2022] PUT /identity/v3/projects/73ba4ff73f75464ea29bb1fa5d1f216e/users/6200fa9ff5cd446893fa55d98e7cdf8a/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:15:50.209724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:50.228817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c57f920-723f-49cf-9f03-e42eaa13a7b6 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:50.229232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:50.343723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd90333-dbdf-47ab-8828-7f19156db7fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:50.344511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd90333-dbdf-47ab-8828-7f19156db7fd admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.344795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd90333-dbdf-47ab-8828-7f19156db7fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.345076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd90333-dbdf-47ab-8828-7f19156db7fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.348232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd90333-dbdf-47ab-8828-7f19156db7fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:50.352117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd90333-dbdf-47ab-8828-7f19156db7fd admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:50.366410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e374451-b84e-4cb9-93f9-64010b77b5a1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:50.376514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fefa0971-7cde-408f-aeb2-7253443c6e12 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:50.377009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 850/1715] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:15:50 2022] GET /identity/v3/roles => generated 1420 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:15:50.379184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0d5b-5af6-4789-b2f7-37c80786a1a4 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.379477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0d5b-5af6-4789-b2f7-37c80786a1a4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.379651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0971-7cde-408f-aeb2-7253443c6e12 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.379784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5ef0d5b-5af6-4789-b2f7-37c80786a1a4 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.380772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0971-7cde-408f-aeb2-7253443c6e12 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.381247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fefa0971-7cde-408f-aeb2-7253443c6e12 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.395713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 851/1716] 10.222.0.20 () {54 vars in 960 bytes} [Wed Jul 6 17:15:50 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:15:50.395713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef0d5b-5af6-4789-b2f7-37c80786a1a4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:50.417262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5ef0d5b-5af6-4789-b2f7-37c80786a1a4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:50.429518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cca97a2-572f-4c2e-a5c6-c500159cadaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:50.430184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca97a2-572f-4c2e-a5c6-c500159cadaf admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.430473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca97a2-572f-4c2e-a5c6-c500159cadaf admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.431483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cca97a2-572f-4c2e-a5c6-c500159cadaf admin admin] PATH_INFO: `/v3/projects/73ba4ff73f75464ea29bb1fa5d1f216e/users/6200fa9ff5cd446893fa55d98e7cdf8a/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.434969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca97a2-572f-4c2e-a5c6-c500159cadaf admin admin] RBAC: Authorizing `identity:create_grant(project_id=73ba4ff73f75464ea29bb1fa5d1f216e, user_id=6200fa9ff5cd446893fa55d98e7cdf8a, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:50.442915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cca97a2-572f-4c2e-a5c6-c500159cadaf admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:50.474006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0971-7cde-408f-aeb2-7253443c6e12 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:50.476685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fefa0971-7cde-408f-aeb2-7253443c6e12 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:50.478995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 852/1717] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:15:50 2022] PUT /identity/v3/projects/73ba4ff73f75464ea29bb1fa5d1f216e/users/6200fa9ff5cd446893fa55d98e7cdf8a/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 87 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:15:50.480367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.481805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.482127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.487923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 866/1718] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 260 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:15:50.491564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.491819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.492102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.529682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:50.531252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:50.536010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:50.540254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] MFA Rules not processed for user `6200fa9ff5cd446893fa55d98e7cdf8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:50.541806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:50.706728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 853/1719] 10.222.0.20 () {58 vars in 1057 bytes} [Wed Jul 6 17:15:50 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:50.708518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:50.723777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 867/1720] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:50 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:50.727839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc7135c9-9e9b-49bc-8246-8ae8a2bdc1bf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:50.772556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:50.778818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:50.781117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:50.785006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:50.793506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:50.818741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:50.818741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e2fcbdb-bb5e-4d9d-a399-0bd90828294c service placement] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:50.832774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 854/1721] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:50.880337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:51.024306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c596bd5d-47b7-4e3f-9287-0c6424b4e8fc None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:51.033003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c0907a-19fb-42dc-8224-daefa8e862d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:51.033742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0907a-19fb-42dc-8224-daefa8e862d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:51.034685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0907a-19fb-42dc-8224-daefa8e862d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:51.034975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c0907a-19fb-42dc-8224-daefa8e862d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:51.062981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0907a-19fb-42dc-8224-daefa8e862d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:51.067754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c0907a-19fb-42dc-8224-daefa8e862d9 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:51.102002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 868/1722] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:15:50 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:15:51.140599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:51.626595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b08ff-bce1-44d0-9f19-c90bf3392e13 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:51.626876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b08ff-bce1-44d0-9f19-c90bf3392e13 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:51.627339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7b08ff-bce1-44d0-9f19-c90bf3392e13 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:51.665176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-bb7b08ff-bce1-44d0-9f19-c90bf3392e13 None None] MFA Rules not processed for user `c4815e3cdfc9485f8c8b0f1d0a0cc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:51.667115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bb7b08ff-bce1-44d0-9f19-c90bf3392e13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:51.827831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 855/1723] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:51 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:52.147436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:52.961443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:53.260482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:53.677109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e213c4-3f3d-4b73-9aaa-c0c4d91e7af5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:53.678078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e213c4-3f3d-4b73-9aaa-c0c4d91e7af5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:53.678281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e213c4-3f3d-4b73-9aaa-c0c4d91e7af5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:53.777332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-06e213c4-3f3d-4b73-9aaa-c0c4d91e7af5 None None] MFA Rules not processed for user `63116783cc3f4f84a11027d5bfdab705`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:53.779240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-06e213c4-3f3d-4b73-9aaa-c0c4d91e7af5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:53.899739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 869/1724] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 224 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:55.241346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:56.007634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:56.008478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:56.008910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:56.059567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] MFA Rules not processed for user `9d3ca58b09634edc9e093d9d9eb0ee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:56.066768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:56.216018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 856/1725] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:15:56 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 209 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:15:57.403837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:57.405164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:57.405975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:57.454458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:15:57.456003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:57.605896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 870/1726] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:15:57 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:15:58.048629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:58.054726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:15:58.157456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:15:58.270897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d5c6d8c-a6b3-4374-b8ac-409d8de82802 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:58.278303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf48ae5-3c0f-4ada-bff6-08f310329ba6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:58.279539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48ae5-3c0f-4ada-bff6-08f310329ba6 service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:58.280841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48ae5-3c0f-4ada-bff6-08f310329ba6 service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:58.281285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf48ae5-3c0f-4ada-bff6-08f310329ba6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:58.317702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf48ae5-3c0f-4ada-bff6-08f310329ba6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:58.319705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf48ae5-3c0f-4ada-bff6-08f310329ba6 service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:15:58.338371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 857/1727] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:15:58 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:15:59.277635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:15:59.601718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9ca9f-fb9c-42ae-bdec-cee90e58a704 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:15:59.616446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:15:59.617697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:15:59.618162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:15:59.618622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] PATH_INFO: `/v3/users/90f1f5ad75244038b979fc85a5e710f3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:15:59.620006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] RBAC: Authorizing `identity:delete_user(user_id=90f1f5ad75244038b979fc85a5e710f3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:15:59.636730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:00.464137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:00.468245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:00.468245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:00.499775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90f1f5ad75244038b979fc85a5e710f3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:00.504658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:00.509408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:00.603940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90f1f5ad75244038b979fc85a5e710f3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:00.653026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90f1f5ad75244038b979fc85a5e710f3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:00.656248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90f1f5ad75244038b979fc85a5e710f3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:00.793656 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f58b66e-2d7f-444a-90a9-f2a579ea5adb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90f1f5ad75244038b979fc85a5e710f3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:00.804863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 871/1728] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:15:59 2022] DELETE /identity/v3/users/90f1f5ad75244038b979fc85a5e710f3 => generated 0 bytes in 1526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:00.806869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:00.807269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:00.807651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:00.855071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 858/1729] 10.222.0.43 () {58 vars in 1015 bytes} [Wed Jul 6 17:16:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 391 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:00.874362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:00.876059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:00.984648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:00.996735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:01.010993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a0148-b515-46d8-9b4c-774274dcead1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:01.264982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 872/1730] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 456 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:01.298214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:01.300283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:01.302000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:01.302409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:01.309274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:01.327927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:01.327927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:01.340690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:01.344790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:01.349024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5044e118-833e-4d1c-bcc1-5e159c424f02 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:01.371791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:01.372572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:01.372913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:01.373192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:01.380248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 859/1731] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 382 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:01.415219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:01.427095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:01.457341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 873/1732] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:04.104963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:04.108744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:04.113652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:04.121215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:04.139753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-370f3359-73d4-4862-9cd8-d8537ad63fac service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:04.149329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:04.151256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:04.151756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:04.152338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] PATH_INFO: `/v3/users/851047e9092445e9b2fa669362f88dcc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:04.154009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=851047e9092445e9b2fa669362f88dcc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:04.157016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:04.206230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d641b4-05c7-4928-8a0b-c2274a43f3ff service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:04.254330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:04.256468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:04.256902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:04.257632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] PATH_INFO: `/v3/projects/5afeb43e77244fd0bc04136802c50169` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:04.260540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] RBAC: Authorizing `identity:delete_project(project_id=5afeb43e77244fd0bc04136802c50169)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:04.264849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:04.430931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '851047e9092445e9b2fa669362f88dcc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.439303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:04.443401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '851047e9092445e9b2fa669362f88dcc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.487897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '851047e9092445e9b2fa669362f88dcc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.489393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '851047e9092445e9b2fa669362f88dcc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.515669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5afeb43e77244fd0bc04136802c50169', 'request_id': 'req-e37a9936-9027-4b9a-946a-02cebd1d6faf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.537201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5afeb43e77244fd0bc04136802c50169', 'request_id': 'req-e37a9936-9027-4b9a-946a-02cebd1d6faf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.580059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5afeb43e77244fd0bc04136802c50169', 'request_id': 'req-e37a9936-9027-4b9a-946a-02cebd1d6faf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.625175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0f0a9e3e-fdbf-442d-a060-08a9f22da5c9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '851047e9092445e9b2fa669362f88dcc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.638658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 860/1733] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:04 2022] DELETE /identity/v3/users/851047e9092445e9b2fa669362f88dcc => generated 0 bytes in 534 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:04.643889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:04.644519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:04.644999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:04.691800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:04.693737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:04.748399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] The token cache is being invalidate because project 5afeb43e77244fd0bc04136802c50169 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:04.748762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.754916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:04.757390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 874/1734] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:04 2022] DELETE /identity/v3/projects/5afeb43e77244fd0bc04136802c50169 => generated 0 bytes in 645 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:04.761083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:04.764679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:04.888009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 861/1735] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:04.917634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:04.919198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:04.943391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37a9936-9027-4b9a-946a-02cebd1d6faf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:04.969223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:04.970968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:04.971425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:04.971867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] PATH_INFO: `/v3/users/6200fa9ff5cd446893fa55d98e7cdf8a` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:04.973479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6200fa9ff5cd446893fa55d98e7cdf8a)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:04.976179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:05.053146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43d7ea96-0546-4b63-ad0e-1a1c75e7c1e7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:05.062524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9247f-68c3-4ea3-b590-ceda9d2184d6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:05.063624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9247f-68c3-4ea3-b590-ceda9d2184d6 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:05.070991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9247f-68c3-4ea3-b590-ceda9d2184d6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:05.071615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9247f-68c3-4ea3-b590-ceda9d2184d6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:05.084735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9247f-68c3-4ea3-b590-ceda9d2184d6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:05.086862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f9247f-68c3-4ea3-b590-ceda9d2184d6 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:05.133305 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 862/1736] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 216 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:05.200723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:05.226432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6200fa9ff5cd446893fa55d98e7cdf8a'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:05.250125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6200fa9ff5cd446893fa55d98e7cdf8a'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:05.260797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6200fa9ff5cd446893fa55d98e7cdf8a'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:05.261763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6200fa9ff5cd446893fa55d98e7cdf8a'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:05.280407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb872-9a06-4296-b8ad-81a7e14658ca None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:05.282404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb872-9a06-4296-b8ad-81a7e14658ca None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:05.282688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90dbb872-9a06-4296-b8ad-81a7e14658ca None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:05.284431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 863/1737] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:16:05 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:16:05.316107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:05.316445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:05.316777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:05.347991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-838d9ae9-ae05-4bcc-9e11-b5f0cc214da5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6200fa9ff5cd446893fa55d98e7cdf8a'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:05.355083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 875/1738] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:04 2022] DELETE /identity/v3/users/6200fa9ff5cd446893fa55d98e7cdf8a => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:05.372419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:05.373992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:05.427038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa094b6-2830-414b-942d-ca34fadf856f None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:05.427332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa094b6-2830-414b-942d-ca34fadf856f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:05.427619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aa094b6-2830-414b-942d-ca34fadf856f None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:05.429490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 876/1739] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:16:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:16:05.506246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 864/1740] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:05.790769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:05.791468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:05.791916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:05.838751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:05.840105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:05.886060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 877/1741] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:16:05 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:06.234780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:06.238965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:06.269742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b665167-11c8-45f0-a7f8-551e3c694839 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:06.312378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:06.315204 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:06.316327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:06.316782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:06.332600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:06.337174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:06.342501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:06.363561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 865/1742] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:06.479671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:06.500565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-227367ca-87b9-4d23-870a-f4e15147d26c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:06.513932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:06.515177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:06.515552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:06.515929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:06.539080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:06.541039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:06.565616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 878/1743] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:07.772403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:07.773833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:07.825242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:07.828087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:07.978756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afc8614-5901-4b99-b6c7-786f5c93d84b service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:07.986995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:07.990006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:07.992580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:07.992580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] PATH_INFO: `/v3/projects/73ba4ff73f75464ea29bb1fa5d1f216e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:07.993406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8482704-b8d8-4c51-8150-7389e56565c4 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:07.993934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73ba4ff73f75464ea29bb1fa5d1f216e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:07.999859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:08.006942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:08.012578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.015759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.015759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] PATH_INFO: `/v3/projects/499e00f27e03468a8ca99f17a2fa8466` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.015759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] RBAC: Authorizing `identity:delete_project(project_id=499e00f27e03468a8ca99f17a2fa8466)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:08.020622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:08.251668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73ba4ff73f75464ea29bb1fa5d1f216e', 'request_id': 'req-80344c8a-1da9-435a-ae5f-8f9a03daac18'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.265263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73ba4ff73f75464ea29bb1fa5d1f216e', 'request_id': 'req-80344c8a-1da9-435a-ae5f-8f9a03daac18'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.276356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73ba4ff73f75464ea29bb1fa5d1f216e', 'request_id': 'req-80344c8a-1da9-435a-ae5f-8f9a03daac18'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.374843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '499e00f27e03468a8ca99f17a2fa8466', 'request_id': 'req-3c31392f-460f-4efd-8c04-26ab6a181708'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.398629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '499e00f27e03468a8ca99f17a2fa8466', 'request_id': 'req-3c31392f-460f-4efd-8c04-26ab6a181708'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.418591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '499e00f27e03468a8ca99f17a2fa8466', 'request_id': 'req-3c31392f-460f-4efd-8c04-26ab6a181708'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.423158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] The token cache is being invalidate because project 73ba4ff73f75464ea29bb1fa5d1f216e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:08.423518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.425112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-80344c8a-1da9-435a-ae5f-8f9a03daac18 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.427238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 866/1744] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:07 2022] DELETE /identity/v3/projects/73ba4ff73f75464ea29bb1fa5d1f216e => generated 0 bytes in 655 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:08.432983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07bb4a-f003-42db-ab5c-79ff822edbdb None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.437293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07bb4a-f003-42db-ab5c-79ff822edbdb None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.437674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d07bb4a-f003-42db-ab5c-79ff822edbdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.510321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2d07bb4a-f003-42db-ab5c-79ff822edbdb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:08.511827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2d07bb4a-f003-42db-ab5c-79ff822edbdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:08.526404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] The token cache is being invalidate because project 499e00f27e03468a8ca99f17a2fa8466 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:08.526744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.529179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3c31392f-460f-4efd-8c04-26ab6a181708 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:08.531433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 879/1745] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:07 2022] DELETE /identity/v3/projects/499e00f27e03468a8ca99f17a2fa8466 => generated 0 bytes in 706 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:08.536522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e763-7d52-4cff-9651-b6742d35a5ea None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.537002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e763-7d52-4cff-9651-b6742d35a5ea None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.537430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d845e763-7d52-4cff-9651-b6742d35a5ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.597300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d845e763-7d52-4cff-9651-b6742d35a5ea None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:08.602714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d845e763-7d52-4cff-9651-b6742d35a5ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:08.664851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:08.701946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 867/1746] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 270 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:08.709096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.709391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.709729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.769104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:08.777434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:08.800504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 880/1747] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:08.805410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 868/1748] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:08.809440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.809872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.810271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.811514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:08.826361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73031c84-f155-4e15-bfe0-3d98d105d701 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:08.852566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:08.854904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:08.859489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:08.860309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.860685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.861207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.862378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:08.863866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:08.865727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:08.872050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 881/1749] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:08.874118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:08.899962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 869/1750] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:08.900867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:08.910097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae30436-301e-4dd3-a924-ac5781554fd3 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:08.914364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:08.918196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:08.919923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.920806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.922096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.923077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:08.926300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:08.928321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:08.928587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7407a6c3-7dd9-4006-b1a4-dcb2d4d06a32 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:08.937962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:08.943132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:08.943427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:08.945876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:08.947295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:08.950901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 882/1751] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:08.957922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:08.980603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:08.999072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a9dfca-75a4-4884-840c-e7dedb75f18b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.006559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.012151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.012151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.012151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.013829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.018554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.226369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 883/1753] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:08 2022] POST /identity/v3/projects => generated 373 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:09.227016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 870/1752] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:08 2022] POST /identity/v3/projects => generated 377 bytes in 322 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:09.227788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.228784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.358382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a23b12-33e5-4a36-bb1e-28c4634d6bbe admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.367644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f91e2cea-bb58-4e94-bf75-604f03838738 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.371717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.372471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.373837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.373837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.374865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.378016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.392206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.398679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.400624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.401389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.411093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.415133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.566695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 871/1754] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:09 2022] POST /identity/v3/users => generated 289 bytes in 339 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:09.572341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.572749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 884/1755] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:09 2022] POST /identity/v3/users => generated 287 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:09.574800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.600860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13761dd8-3e3c-4181-b402-b2deb78849ab admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.610648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea6bc401-64a7-4328-a67d-8a4adaec6b62 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.622437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.625259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.627016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.628238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.629858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.632044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.633024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.633313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.635978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.636777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.637236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.662006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.674344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 872/1756] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:09.680944 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.730428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee5508c7-a7fa-43a5-a928-b0d13fb9fd7a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.731398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 885/1757] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:09.736019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.758337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.759805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.765128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.767292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.772335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.777978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.792152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fb58357-4989-4e66-8812-6cdf6f4c0087 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.817749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.819404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.820058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.820806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.821516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 873/1758] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:09.822849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.826009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.835590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.852669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-973f75de-2749-463a-8415-3eaf49d6dba5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.866545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59984747-eb23-4b40-901a-a393060759d8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.868960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984747-eb23-4b40-901a-a393060759d8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.871238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984747-eb23-4b40-901a-a393060759d8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.871882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59984747-eb23-4b40-901a-a393060759d8 admin admin] PATH_INFO: `/v3/projects/eb83d95785f043e181d3ecde4d287a3f/users/01e4f4a1b9714452986f3a67010490bf/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:09.911229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59984747-eb23-4b40-901a-a393060759d8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=eb83d95785f043e181d3ecde4d287a3f, user_id=01e4f4a1b9714452986f3a67010490bf, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:09.914482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59984747-eb23-4b40-901a-a393060759d8 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:09.929083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 886/1759] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:09 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:09.932330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:09.974428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e4310e4-1dbf-4408-a427-b50af03373ff admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:09.994212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb014f6-8845-4ce7-90e6-55dcfcb8c795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:09.996223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb014f6-8845-4ce7-90e6-55dcfcb8c795 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:09.997052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb014f6-8845-4ce7-90e6-55dcfcb8c795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:09.997906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb014f6-8845-4ce7-90e6-55dcfcb8c795 admin admin] PATH_INFO: `/v3/projects/f56146b43452404ba38aa7ad5bad1653/users/621fba4791ca47db9256e3a599124a08/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:10.012468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 874/1760] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:09 2022] PUT /identity/v3/projects/eb83d95785f043e181d3ecde4d287a3f/users/01e4f4a1b9714452986f3a67010490bf/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:10.040109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:10.040395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:10.040848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:10.095495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] MFA Rules not processed for user `01e4f4a1b9714452986f3a67010490bf`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:10.102860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:10.208034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb014f6-8845-4ce7-90e6-55dcfcb8c795 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f56146b43452404ba38aa7ad5bad1653, user_id=621fba4791ca47db9256e3a599124a08, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:10.212296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb014f6-8845-4ce7-90e6-55dcfcb8c795 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:10.237992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 875/1761] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:10 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:10.242337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:10.342897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 887/1762] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:09 2022] PUT /identity/v3/projects/f56146b43452404ba38aa7ad5bad1653/users/621fba4791ca47db9256e3a599124a08/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 411 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:10.353442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:10.353727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:10.354121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:10.416731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fbb366f-7934-4468-bbf5-99f4b7295b0a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:10.430936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] MFA Rules not processed for user `621fba4791ca47db9256e3a599124a08`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:10.432297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:10.454682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:10.538532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:10.538532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:10.538532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:10.538532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:10.539199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:10.541299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:10.567317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 888/1763] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:10.683922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 876/1764] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:10 2022] POST /identity/v3/projects => generated 379 bytes in 445 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:10.688085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:10.718964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-772ed492-bf6d-4881-ba2e-91065c15467f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:10.782055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:10.784744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:10.866445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:10.867752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:10.868363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:10.868786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:10.870410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:10.873412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:10.883320 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:10.981001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 889/1765] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:10 2022] POST /identity/v3/users => generated 296 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:10.985766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:11.012940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abf3a2f-a130-4a55-9914-3a2f30198e0e admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:11.021889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:11.022973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:11.023793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:11.025611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:11.026666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:11.028499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:11.031898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83202098-96c9-48b4-a582-3023954fa73d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:11.051980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:11.052987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:11.053371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:11.053733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:11.063388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 890/1766] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:10 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:11.065252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:11.087947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b22f392-9c3b-46d3-95ad-7e42ef978749 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:11.103029 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:11.105083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:11.105546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:11.110766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] PATH_INFO: `/v3/projects/a773805e3e7842a4b8b365e7a71b1f08/users/e21a94ef156a4455ba70ce9d70aa34c8/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:11.152404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a773805e3e7842a4b8b365e7a71b1f08, user_id=e21a94ef156a4455ba70ce9d70aa34c8, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:11.162341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:11.229718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:11.232322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:11.259528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 891/1767] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:11 2022] PUT /identity/v3/projects/a773805e3e7842a4b8b365e7a71b1f08/users/e21a94ef156a4455ba70ce9d70aa34c8/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:11.259528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:11.265089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 877/1768] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 483 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:11.466986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d429a5-0170-4b22-b9ac-62d509f51569 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:11.478878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e669d72b-1bf0-4684-a21d-d2c3bb3a9f49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:11.479852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d72b-1bf0-4684-a21d-d2c3bb3a9f49 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:11.480125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d72b-1bf0-4684-a21d-d2c3bb3a9f49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:11.480476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e669d72b-1bf0-4684-a21d-d2c3bb3a9f49 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:11.481201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d72b-1bf0-4684-a21d-d2c3bb3a9f49 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:11.483011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e669d72b-1bf0-4684-a21d-d2c3bb3a9f49 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:11.495343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 892/1769] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:11 2022] GET /identity/v3/roles => generated 1420 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:11.499395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:11.514170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b137a-0c1e-478c-b080-ac9d446a2838 service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:11.522522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:11.524789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:11.525224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:11.525785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] PATH_INFO: `/v3/projects/a773805e3e7842a4b8b365e7a71b1f08/users/e21a94ef156a4455ba70ce9d70aa34c8/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:11.529508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a773805e3e7842a4b8b365e7a71b1f08, user_id=e21a94ef156a4455ba70ce9d70aa34c8, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:11.539973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:11.554912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 878/1770] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:11 2022] PUT /identity/v3/projects/a773805e3e7842a4b8b365e7a71b1f08/users/e21a94ef156a4455ba70ce9d70aa34c8/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:11.565216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:11.565618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:11.565904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:11.641762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] MFA Rules not processed for user `e21a94ef156a4455ba70ce9d70aa34c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:11.649133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:11.683615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:11.862042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 893/1771] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:11 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:11.935701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:11.937848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:12.072540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3f913d-550f-446f-a7d4-c4e8abc22060 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:12.072540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b45bbe25-f318-4346-bc25-ddde5a4ef316 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:12.072540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bbe25-f318-4346-bc25-ddde5a4ef316 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:12.072540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bbe25-f318-4346-bc25-ddde5a4ef316 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:12.080147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b45bbe25-f318-4346-bc25-ddde5a4ef316 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:12.412033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bbe25-f318-4346-bc25-ddde5a4ef316 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:12.412033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b45bbe25-f318-4346-bc25-ddde5a4ef316 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:12.412033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 879/1772] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:11 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:12.742649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:13.015332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:13.079963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da5eeb74-36c7-48ae-948d-56fcdb7e796a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:13.084597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:13.085484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:13.085768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:13.086079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] PATH_INFO: `/v3/users/621fba4791ca47db9256e3a599124a08` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:13.087261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] RBAC: Authorizing `identity:delete_user(user_id=621fba4791ca47db9256e3a599124a08)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:13.089202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:13.324015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '621fba4791ca47db9256e3a599124a08'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:13.338913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '621fba4791ca47db9256e3a599124a08'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:13.348038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '621fba4791ca47db9256e3a599124a08'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:13.350876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '621fba4791ca47db9256e3a599124a08'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:13.430875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '621fba4791ca47db9256e3a599124a08'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:13.437256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 894/1773] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:13 2022] DELETE /identity/v3/users/621fba4791ca47db9256e3a599124a08 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:13.442078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:13.442078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:13.442635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:13.459994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:13.461264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:13.525272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 880/1774] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:13.534942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:13.537313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:13.599801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae3fa349-cd38-4e16-b66f-446b4a45cd3f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:13.603697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:13.604349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:13.604637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:13.604918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:13.614514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:13.615985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:13.625983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 895/1775] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:13.960071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:14.133183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.134732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:14.147409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce0714c-11ba-449a-b1e2-ec6b5c3bc02b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.152272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.153504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.153504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.153878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] PATH_INFO: `/v3/projects/f56146b43452404ba38aa7ad5bad1653` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.155558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] RBAC: Authorizing `identity:delete_project(project_id=f56146b43452404ba38aa7ad5bad1653)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.156825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.285113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f56146b43452404ba38aa7ad5bad1653', 'request_id': 'req-9b994896-b0ce-4b27-9f4c-b1165bdf825e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:14.290704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f56146b43452404ba38aa7ad5bad1653', 'request_id': 'req-9b994896-b0ce-4b27-9f4c-b1165bdf825e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:14.296994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f56146b43452404ba38aa7ad5bad1653', 'request_id': 'req-9b994896-b0ce-4b27-9f4c-b1165bdf825e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:14.327042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.330297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:14.347314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] The token cache is being invalidate because project f56146b43452404ba38aa7ad5bad1653 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:14.353528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:14.353528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9b994896-b0ce-4b27-9f4c-b1165bdf825e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:14.353528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 881/1776] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:14 2022] DELETE /identity/v3/projects/f56146b43452404ba38aa7ad5bad1653 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:14.354350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6c5a-bcd8-4774-9b16-763372cbc431 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.354638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6c5a-bcd8-4774-9b16-763372cbc431 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.354921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6bb6c5a-bcd8-4774-9b16-763372cbc431 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.375477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b6bb6c5a-bcd8-4774-9b16-763372cbc431 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:14.376774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b6bb6c5a-bcd8-4774-9b16-763372cbc431 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:14.387036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74d310b3-fd65-4b15-a5d5-6c539cfe62d3 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.439989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.441179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.441798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.442306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.442425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 882/1777] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:14.444936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:14.452073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.452413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.452690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.475846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:14.479654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:14.487589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 883/1778] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:14.491437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.502748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37289072-1ce1-4921-9024-02be8f3be8bb None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.508687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.509459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.509732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.510462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.511690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:14.512256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.515157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.539823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 884/1779] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:14.541649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:14.543159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.555064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.556527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.560562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dcb53a1-af79-4737-b59b-c49474407593 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.565654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.566547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.569073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.569073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.569073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.569363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 896/1780] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:14 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:14.570094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.691405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 885/1781] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:14 2022] POST /identity/v3/projects => generated 381 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:14.693923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.704321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c625903-1ea5-4c75-bc43-05096c55bbfa service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.769000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.769700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.769980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.770293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.771000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.773092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.917077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 897/1782] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:14 2022] POST /identity/v3/users => generated 291 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:14.920929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.931248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68fd1595-232b-42af-9dae-e8dd9d9a2153 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.935852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.937922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.937922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.937922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.937922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.939527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.949805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 886/1783] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:14.953815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.964294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5517de-72bc-4dbe-830c-367e06d47db1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:14.968824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b139cfce-4808-40e8-94f5-d735ffc05d1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:14.969478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139cfce-4808-40e8-94f5-d735ffc05d1c admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:14.969786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139cfce-4808-40e8-94f5-d735ffc05d1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:14.970052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b139cfce-4808-40e8-94f5-d735ffc05d1c admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:14.970788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139cfce-4808-40e8-94f5-d735ffc05d1c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:14.972981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b139cfce-4808-40e8-94f5-d735ffc05d1c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:14.982790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 898/1784] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:14 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:14.987110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:14.997188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15d5b8db-9303-4949-bbb8-a662d7e49228 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.002619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.003504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.003792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.004073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] PATH_INFO: `/v3/projects/23c780d860c94d10a66f3d05d99a6ad8/users/66a5075bdb234f4d9164a4284c029df7/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.019510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] RBAC: Authorizing `identity:create_grant(project_id=23c780d860c94d10a66f3d05d99a6ad8, user_id=66a5075bdb234f4d9164a4284c029df7, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.022155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.109028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 887/1785] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:14 2022] PUT /identity/v3/projects/23c780d860c94d10a66f3d05d99a6ad8/users/66a5075bdb234f4d9164a4284c029df7/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:15.119553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.119845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.120203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.150787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] MFA Rules not processed for user `66a5075bdb234f4d9164a4284c029df7`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:15.152105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:15.215184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 899/1786] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:15.220067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.290860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23afe0b3-fff0-407b-81cd-fd9d30bb676e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.296638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.297314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.297610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.297881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.298620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.300595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.414906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 888/1787] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:15 2022] POST /identity/v3/projects => generated 381 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:15.418956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.430837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-905a156e-d624-40b2-9bc7-4e102640d804 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.494531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.495207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.495488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.495853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.496542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.498509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.508698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:15.591524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 900/1788] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:15 2022] POST /identity/v3/users => generated 297 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:16:15.593914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.602179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.603987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:15.605630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dbf4fc3-78ea-4cd3-b659-19f57278af56 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.614839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.616708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.616708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.616708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.616708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.618664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:15.618894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.626559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c89f57-f950-4d6c-8e3a-5170cb2062da admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.632880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.634062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.634430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.634966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] PATH_INFO: `/v3/users/0d974c99b6e74835beabd0863b95bdf2` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.636659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0d974c99b6e74835beabd0863b95bdf2)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.639499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 889/1789] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:15.643712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.644273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.657300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be058faf-bd56-4ac6-9c3f-0e9beee646f5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.667455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.670491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.670491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.670491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] PATH_INFO: `/v3/projects/1e1faea0c5ec40e1af427d5f1431e750/users/cbe6346107a142b582b4e90b0608ca8c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.689270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1faea0c5ec40e1af427d5f1431e750, user_id=cbe6346107a142b582b4e90b0608ca8c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.693389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.816784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 890/1790] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:15 2022] PUT /identity/v3/projects/1e1faea0c5ec40e1af427d5f1431e750/users/cbe6346107a142b582b4e90b0608ca8c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:15.820752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.858256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0d974c99b6e74835beabd0863b95bdf2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:15.872119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0d974c99b6e74835beabd0863b95bdf2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:15.878932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0d974c99b6e74835beabd0863b95bdf2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:15.879658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0d974c99b6e74835beabd0863b95bdf2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:15.890953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e813734d-8f45-4420-b893-4b8667878049 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.896472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.900100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.900100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.900100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.900100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.900100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.914237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 891/1791] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:15 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:15.925008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:15.933498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3eb22497-d645-40a6-a5cb-5b7bb374cff5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:15.939459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d659088-de62-461e-a411-11afd898938e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:15.940475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659088-de62-461e-a411-11afd898938e admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.940767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659088-de62-461e-a411-11afd898938e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.941050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d659088-de62-461e-a411-11afd898938e admin admin] PATH_INFO: `/v3/projects/1e1faea0c5ec40e1af427d5f1431e750/users/cbe6346107a142b582b4e90b0608ca8c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.943134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659088-de62-461e-a411-11afd898938e admin admin] RBAC: Authorizing `identity:create_grant(project_id=1e1faea0c5ec40e1af427d5f1431e750, user_id=cbe6346107a142b582b4e90b0608ca8c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:15.946790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d659088-de62-461e-a411-11afd898938e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:15.960589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 892/1792] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:15 2022] PUT /identity/v3/projects/1e1faea0c5ec40e1af427d5f1431e750/users/cbe6346107a142b582b4e90b0608ca8c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:15.971338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9633b9d5-c408-4a8f-8ce9-efe4d64dd150 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0d974c99b6e74835beabd0863b95bdf2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:15.974140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.974140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.974140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:15.981062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 901/1793] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:15 2022] DELETE /identity/v3/users/0d974c99b6e74835beabd0863b95bdf2 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:15.986021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:15.990409 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:15.990813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:16.015601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:16.016951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] MFA Rules not processed for user `cbe6346107a142b582b4e90b0608ca8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:16.017553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:16.019686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:16.022440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:INSERT=6,keystone:DELETE=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:16.119259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 902/1794] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:16.131350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:16.131350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:16.139195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 893/1795] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:15 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:16.154309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:16.159682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:16.192190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be9dbbbf-017e-4d6c-ac1e-1669aaef48d4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:16.196127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:16.196781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:16.197066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:16.197348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:16.207434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:16.209081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:16.219678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 903/1796] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:16.221731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b73be858-1757-42dd-be56-7d56d564e74c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:16.225701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:16.226396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:16.226823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:16.227115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:16.237736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:16.239854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:16.245707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:16.252140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 894/1797] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:16 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:16.720021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:16.721440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:16.736537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c30da1ad-dc78-40d8-880f-2cff9057a310 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:16.752898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:16.752898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:16.752898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:16.752898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] PATH_INFO: `/v3/projects/4350c1251ed6429fafa7b042a6b6fbad` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:16.753410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4350c1251ed6429fafa7b042a6b6fbad)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:16.753410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:16.899572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:16.914912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4350c1251ed6429fafa7b042a6b6fbad', 'request_id': 'req-757a7eac-45bb-44f8-9d86-01bad04c6506'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:16.920492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4350c1251ed6429fafa7b042a6b6fbad', 'request_id': 'req-757a7eac-45bb-44f8-9d86-01bad04c6506'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:16.927229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4350c1251ed6429fafa7b042a6b6fbad', 'request_id': 'req-757a7eac-45bb-44f8-9d86-01bad04c6506'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.027887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] The token cache is being invalidate because project 4350c1251ed6429fafa7b042a6b6fbad was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:17.028176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.028895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.030498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 904/1798] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:16 2022] DELETE /identity/v3/projects/4350c1251ed6429fafa7b042a6b6fbad => generated 0 bytes in 311 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:17.034606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:17.045255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea60cc8e-15b2-4cf3-bdfc-441de4cfc689 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:17.121635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:17.122585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:17.122862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:17.123136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] PATH_INFO: `/v3/users/56dd31506d224e5dbf0cad447885f871` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:17.125311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] RBAC: Authorizing `identity:delete_user(user_id=56dd31506d224e5dbf0cad447885f871)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:17.128296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:17.353251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '56dd31506d224e5dbf0cad447885f871'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.362471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '56dd31506d224e5dbf0cad447885f871'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.381169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '56dd31506d224e5dbf0cad447885f871'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.381925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '56dd31506d224e5dbf0cad447885f871'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.416645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:17.418206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:17.458240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '56dd31506d224e5dbf0cad447885f871'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:17.466856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 895/1799] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:17 2022] DELETE /identity/v3/users/56dd31506d224e5dbf0cad447885f871 => generated 0 bytes in 433 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:17.509891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-757a7eac-45bb-44f8-9d86-01bad04c6506 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:17.593428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe6346107a142b582b4e90b0608ca8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1faea0c5ec40e1af427d5f1431e750', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:17.593800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:17.594111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:17.594395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:17.595131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:17.595639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:17.597645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:17.610920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 905/1800] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:17.615837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:17.617605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:17.631283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd0092c4-dc69-482a-8af1-eb201eaf88ed admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:17.636008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe6346107a142b582b4e90b0608ca8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1faea0c5ec40e1af427d5f1431e750', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:17.636700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:17.636992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:17.637273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:17.637969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:17.639919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:17.662060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:18.584338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 896/1801] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:17 2022] POST /identity/v3/projects => generated 355 bytes in 969 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:18.588462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:18.605895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf4329c-6a26-4b12-89cf-14133183c6b5 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:18.635362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:18.637535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:18.664867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:18.671002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe6346107a142b582b4e90b0608ca8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1faea0c5ec40e1af427d5f1431e750', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:18.671868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:18.672177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:18.672444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:18.679966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:18.680309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:18.682810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:18.702763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 906/1802] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:18.724937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ba04a5-65db-4062-a337-671796d0df4f tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:18.732300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:18.734679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:18.736226 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:18.737104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] PATH_INFO: `/v3/projects/5467da5f36434e2ca4da14c401cb88fe` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:18.739859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] RBAC: Authorizing `identity:delete_project(project_id=5467da5f36434e2ca4da14c401cb88fe)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:18.742335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:18.760823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:18.767987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a99715bc-ce3b-4858-b70e-fa1435030928 tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:18.774237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'cbe6346107a142b582b4e90b0608ca8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '1e1faea0c5ec40e1af427d5f1431e750', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:18.784427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:18.784715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:18.785383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] PATH_INFO: `/v3/projects/8b564af67ce34c2e8ea62354556f9f83` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:18.786704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorizing `identity:delete_project(project_id=8b564af67ce34c2e8ea62354556f9f83)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:18.788601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:18.904403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b564af67ce34c2e8ea62354556f9f83', 'request_id': 'req-9cd6a112-4d9c-4124-9e37-d5a03834ffda'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:18.912667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b564af67ce34c2e8ea62354556f9f83', 'request_id': 'req-9cd6a112-4d9c-4124-9e37-d5a03834ffda'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:18.918431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5467da5f36434e2ca4da14c401cb88fe', 'request_id': 'req-40a21afa-39cb-44a0-8270-bce1164df25f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:18.923736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b564af67ce34c2e8ea62354556f9f83', 'request_id': 'req-9cd6a112-4d9c-4124-9e37-d5a03834ffda'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:18.928543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5467da5f36434e2ca4da14c401cb88fe', 'request_id': 'req-40a21afa-39cb-44a0-8270-bce1164df25f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:18.938743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5467da5f36434e2ca4da14c401cb88fe', 'request_id': 'req-40a21afa-39cb-44a0-8270-bce1164df25f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:19.044264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] The token cache is being invalidate because project 8b564af67ce34c2e8ea62354556f9f83 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:19.044553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:19.045195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9cd6a112-4d9c-4124-9e37-d5a03834ffda tempest-VolumeQuotaClassesTest-1988567954 tempest-VolumeQuotaClassesTest-1988567954-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:19.046795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 907/1803] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:18 2022] DELETE /identity/v3/projects/8b564af67ce34c2e8ea62354556f9f83 => generated 0 bytes in 291 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:19.130405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] The token cache is being invalidate because project 5467da5f36434e2ca4da14c401cb88fe was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:19.130693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:19.131308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-40a21afa-39cb-44a0-8270-bce1164df25f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:19.132937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 897/1804] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:18 2022] DELETE /identity/v3/projects/5467da5f36434e2ca4da14c401cb88fe => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:19.138534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.138822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.139095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.157043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:19.158278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:19.218638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 908/1805] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:19.227601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.228135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.228478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.255564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:19.255564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:19.260891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 898/1806] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:19.267715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.277562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51eb1763-21d9-4fb5-b40e-f2d20c92a024 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.282420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.283201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.283698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.284223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.284916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:19.285255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.286980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.298577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 909/1807] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:19.303807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.313309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750eceef-fb6b-443e-a1a7-4e1378bbc3a6 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.318930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.319589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.319875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.320154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.320863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.322837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.426936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 899/1808] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:19 2022] POST /identity/v3/projects => generated 383 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:19.431118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.441101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77d53e49-28d8-4989-952e-2eb403ad86b8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.496526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.497066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.497383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.497630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.498359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.500285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.583636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 910/1809] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:19 2022] POST /identity/v3/users => generated 292 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:19.585018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.601474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf680770-366c-4990-8376-b3dd9fc188c3 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.606683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.607611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.618454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.618920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.620334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.622979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.637301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 900/1810] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:19.640980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.659070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d23b065-bd09-4200-ad6d-a01396c124e2 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.665455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-898dd5c5-ddb1-4618-b084-a2ab7d08894f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.666520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd5c5-ddb1-4618-b084-a2ab7d08894f admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.667019 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd5c5-ddb1-4618-b084-a2ab7d08894f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.667615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-898dd5c5-ddb1-4618-b084-a2ab7d08894f admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.675875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd5c5-ddb1-4618-b084-a2ab7d08894f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.675875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-898dd5c5-ddb1-4618-b084-a2ab7d08894f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.683123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 911/1811] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:19 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:19.690719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.705029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b85a9330-ad34-424a-b744-13a075bf1c67 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.724817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.725730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.726022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.726329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] PATH_INFO: `/v3/projects/06ee0e2de7284b80a973b0ce46e7c36e/users/575157441766495c91a171f495fa9988/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.754172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ee0e2de7284b80a973b0ce46e7c36e, user_id=575157441766495c91a171f495fa9988, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.758644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.847295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 901/1812] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:19 2022] PUT /identity/v3/projects/06ee0e2de7284b80a973b0ce46e7c36e/users/575157441766495c91a171f495fa9988/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:19.859461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.859761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.860044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.863325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.867745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:19.891231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] MFA Rules not processed for user `575157441766495c91a171f495fa9988`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:19.892637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:19.942439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-423065a1-4fd4-44eb-b8ec-e62cc8bbe16c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.948578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.949601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.949966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.950534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] PATH_INFO: `/v3/users/66a5075bdb234f4d9164a4284c029df7` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.952002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] RBAC: Authorizing `identity:delete_user(user_id=66a5075bdb234f4d9164a4284c029df7)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.954262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:19.973991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 912/1813] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:19 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:19.973991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:19.973991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:19.987425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-838513bf-0175-43f1-878c-6cc0bed83652 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:19.992426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:19.993401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:19.993742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:19.994137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] PATH_INFO: `/v3/users/01e4f4a1b9714452986f3a67010490bf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:19.995632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=01e4f4a1b9714452986f3a67010490bf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:19.997803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:20.054014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:20.232471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '66a5075bdb234f4d9164a4284c029df7'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.239979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '66a5075bdb234f4d9164a4284c029df7'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.254754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '66a5075bdb234f4d9164a4284c029df7'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.255505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '66a5075bdb234f4d9164a4284c029df7'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.261515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01e4f4a1b9714452986f3a67010490bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.274938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01e4f4a1b9714452986f3a67010490bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.283944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01e4f4a1b9714452986f3a67010490bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.284853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01e4f4a1b9714452986f3a67010490bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.340220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '66a5075bdb234f4d9164a4284c029df7'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.348057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 902/1814] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:19 2022] DELETE /identity/v3/users/66a5075bdb234f4d9164a4284c029df7 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:20.348820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:20.350243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:20.399606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:20.421657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de5eedc-e086-4022-be80-eb6ee209f4fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01e4f4a1b9714452986f3a67010490bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:20.433460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 913/1815] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:19 2022] DELETE /identity/v3/users/01e4f4a1b9714452986f3a67010490bf => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:20.433460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523bdf2-6c28-4776-93ad-4893cbcf043f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.433460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523bdf2-6c28-4776-93ad-4893cbcf043f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.433460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3523bdf2-6c28-4776-93ad-4893cbcf043f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.434938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e64f606-97db-497d-b6d6-c832e5c71421 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:20.459663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3523bdf2-6c28-4776-93ad-4893cbcf043f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:20.460940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3523bdf2-6c28-4776-93ad-4893cbcf043f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:20.513562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:20.514561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.515124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.515456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.516721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:20.519643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:20.523794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 914/1816] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:20.525265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.525657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.526058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.557038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:20.558495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:20.567333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 915/1817] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:20.570292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:20.570292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:20.631677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63bf2ddd-f7c3-4a1b-938b-6594f3745b8a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:20.635198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:20.635855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.636136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.636410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.647322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 903/1818] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:20 2022] POST /identity/v3/projects => generated 381 bytes in 299 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:20.648861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:20.655328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:20.656782 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:20.679790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 916/1819] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:20.680778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:20.687933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:20.715144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db1334d0-398c-4201-b27b-616738062dd7 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:20.724916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6afd74e-5beb-43ac-a0ba-813c280e0a42 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:20.729713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:20.730861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.731289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.731932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.805812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:20.807298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:20.819343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 904/1820] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:20.824964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:20.826382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.827367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.828410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.828534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:20.832608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:20.964862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 917/1821] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:20 2022] POST /identity/v3/users => generated 297 bytes in 284 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:20.969349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:20.979296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3ad09-970b-42a4-bff5-aeed94f6de8b service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:20.983799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:20.984447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:20.984729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:20.985009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:20.985822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:20.987450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:20.997443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 905/1822] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:20 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:21.001599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.012322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8370c347-3e11-4d83-9cff-5f650227659a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.017259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.018805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.019082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.019351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] PATH_INFO: `/v3/projects/be024bb983bd4d2b8e4059b770779d8c/users/0c2262adc501456a8784a941d748def3/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.035404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] RBAC: Authorizing `identity:create_grant(project_id=be024bb983bd4d2b8e4059b770779d8c, user_id=0c2262adc501456a8784a941d748def3, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.038660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.141665 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 918/1823] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:21 2022] PUT /identity/v3/projects/be024bb983bd4d2b8e4059b770779d8c/users/0c2262adc501456a8784a941d748def3/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:21.145130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.157250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c99d248f-431e-4de8-ba3c-e1114a40aa70 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.232913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c76314-8be4-4cc6-8bab-9100a4742607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.233736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76314-8be4-4cc6-8bab-9100a4742607 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.234042 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76314-8be4-4cc6-8bab-9100a4742607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.234358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c76314-8be4-4cc6-8bab-9100a4742607 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.235100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c76314-8be4-4cc6-8bab-9100a4742607 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.237302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3c76314-8be4-4cc6-8bab-9100a4742607 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.248942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 906/1824] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:21 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:21.253826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.265106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f321c1b-6a72-4ab2-94ae-3d7d5ba8b9fc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.270713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.272003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.272485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.273069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] PATH_INFO: `/v3/projects/be024bb983bd4d2b8e4059b770779d8c/users/0c2262adc501456a8784a941d748def3/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.276194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be024bb983bd4d2b8e4059b770779d8c, user_id=0c2262adc501456a8784a941d748def3, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.279451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.306927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 919/1825] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:21 2022] PUT /identity/v3/projects/be024bb983bd4d2b8e4059b770779d8c/users/0c2262adc501456a8784a941d748def3/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:21.308887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.309186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.311454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.343034 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] MFA Rules not processed for user `0c2262adc501456a8784a941d748def3`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:21.348484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.391424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:21.421811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.423558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=3,keystone:SELECT=87,keystone:DELETE=10 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:21.425389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.434074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 907/1826] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:21 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:21.444381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.445824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.502972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdfa1efd-0b3c-4815-90b9-8d302f11ed28 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.503155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d525c0a-a5a7-4a1a-a148-f422915db7a7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.506732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.507380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.507615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.507741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.507929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.508464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.509327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.509613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] PATH_INFO: `/v3/projects/23c780d860c94d10a66f3d05d99a6ad8` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.510826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=23c780d860c94d10a66f3d05d99a6ad8)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.512738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.517027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.518992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.528921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 908/1827] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:21 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:21.534278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.537002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.559369 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a4e8f9b-d87d-41ba-a45c-0e57a56a60ad service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.564586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.568422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.568422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.568422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] PATH_INFO: `/v3/projects/eb83d95785f043e181d3ecde4d287a3f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.568422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eb83d95785f043e181d3ecde4d287a3f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.569633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.671027 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '23c780d860c94d10a66f3d05d99a6ad8', 'request_id': 'req-ef001080-5b18-46af-a133-6e897b8ba8bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.678709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '23c780d860c94d10a66f3d05d99a6ad8', 'request_id': 'req-ef001080-5b18-46af-a133-6e897b8ba8bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.685921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '23c780d860c94d10a66f3d05d99a6ad8', 'request_id': 'req-ef001080-5b18-46af-a133-6e897b8ba8bf'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.703595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eb83d95785f043e181d3ecde4d287a3f', 'request_id': 'req-bc1be809-f85f-440f-9a5b-99806b4b6294'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.710391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eb83d95785f043e181d3ecde4d287a3f', 'request_id': 'req-bc1be809-f85f-440f-9a5b-99806b4b6294'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.717180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eb83d95785f043e181d3ecde4d287a3f', 'request_id': 'req-bc1be809-f85f-440f-9a5b-99806b4b6294'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.758242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] The token cache is being invalidate because project 23c780d860c94d10a66f3d05d99a6ad8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:21.759412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.760306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.762555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 920/1828] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:21 2022] DELETE /identity/v3/projects/23c780d860c94d10a66f3d05d99a6ad8 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:21.766547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.768547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.831777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef001080-5b18-46af-a133-6e897b8ba8bf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.848661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] The token cache is being invalidate because project eb83d95785f043e181d3ecde4d287a3f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:21.849482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.850372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:21.852269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 909/1829] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:21 2022] DELETE /identity/v3/projects/eb83d95785f043e181d3ecde4d287a3f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:21.853450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.855197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.887752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.888421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.888710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.889056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.891042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:21.951681 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc1be809-f85f-440f-9a5b-99806b4b6294 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:21.958508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:21.959918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:21.960469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:21.961051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] PATH_INFO: `/v3/users/cbe6346107a142b582b4e90b0608ca8c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:21.963292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cbe6346107a142b582b4e90b0608ca8c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.965588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.971520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:21.973241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:21.982724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 921/1830] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:21 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:21.983696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:21.984999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:22.005373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eba0863-0889-475e-94e3-96a193de038c service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:22.010378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:22.011233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:22.011518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:22.012118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] PATH_INFO: `/v3/users/e21a94ef156a4455ba70ce9d70aa34c8` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:22.013376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e21a94ef156a4455ba70ce9d70aa34c8)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:22.016328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:22.205774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cbe6346107a142b582b4e90b0608ca8c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.214545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cbe6346107a142b582b4e90b0608ca8c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.228562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cbe6346107a142b582b4e90b0608ca8c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.229497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cbe6346107a142b582b4e90b0608ca8c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.262996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e21a94ef156a4455ba70ce9d70aa34c8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.292585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e21a94ef156a4455ba70ce9d70aa34c8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.301872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e21a94ef156a4455ba70ce9d70aa34c8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.302660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e21a94ef156a4455ba70ce9d70aa34c8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.330703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ebd05c23-ea82-4184-97f7-f9ebdd2740f2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cbe6346107a142b582b4e90b0608ca8c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.339545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 910/1831] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:21 2022] DELETE /identity/v3/users/cbe6346107a142b582b4e90b0608ca8c => generated 0 bytes in 486 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:22.352312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34d3b4-053e-415a-9ae0-dc5c12e75cd1 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:22.352854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34d3b4-053e-415a-9ae0-dc5c12e75cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:22.353137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b34d3b4-053e-415a-9ae0-dc5c12e75cd1 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:22.354730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 911/1832] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:16:22 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:16:22.365308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:22.365864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:22.366436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:22.422157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:22.423442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:22.436585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e21a94ef156a4455ba70ce9d70aa34c8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:22.451502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 922/1833] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:21 2022] DELETE /identity/v3/users/e21a94ef156a4455ba70ce9d70aa34c8 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:22.537136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 912/1834] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:16:22 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:22.557224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:22.558719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:22.641651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37999842-b791-4d23-97d1-b507f205d765 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:22.647770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:22.648462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:22.649111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:22.649463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:22.659776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:22.661525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:22.675369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 923/1835] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:22 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:22.702718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:22.782202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:23.206836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.209200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:23.214134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.215849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:23.284421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-085f0d88-4590-440f-9881-3a955e3e7bda None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.313758 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef4dc0ac-fd27-420c-b274-c30cf270f888 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.319085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:23.321471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.321790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.322139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] PATH_INFO: `/v3/projects/1e1faea0c5ec40e1af427d5f1431e750` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.323418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1e1faea0c5ec40e1af427d5f1431e750)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:23.325325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:23.347342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:23.348268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.348556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.348838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] PATH_INFO: `/v3/projects/a773805e3e7842a4b8b365e7a71b1f08` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.350422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a773805e3e7842a4b8b365e7a71b1f08)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:23.352404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:23.464729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1e1faea0c5ec40e1af427d5f1431e750', 'request_id': 'req-5a9b0fc7-a8ab-4067-a827-764fbc004048'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.475124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1e1faea0c5ec40e1af427d5f1431e750', 'request_id': 'req-5a9b0fc7-a8ab-4067-a827-764fbc004048'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.482796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1e1faea0c5ec40e1af427d5f1431e750', 'request_id': 'req-5a9b0fc7-a8ab-4067-a827-764fbc004048'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.540043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a773805e3e7842a4b8b365e7a71b1f08', 'request_id': 'req-0fe0b62b-e7cf-4882-86c0-4d4946549c03'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.547278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a773805e3e7842a4b8b365e7a71b1f08', 'request_id': 'req-0fe0b62b-e7cf-4882-86c0-4d4946549c03'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.556604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a773805e3e7842a4b8b365e7a71b1f08', 'request_id': 'req-0fe0b62b-e7cf-4882-86c0-4d4946549c03'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.596446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] The token cache is being invalidate because project 1e1faea0c5ec40e1af427d5f1431e750 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:23.596735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.597369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5a9b0fc7-a8ab-4067-a827-764fbc004048 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.599012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 924/1836] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:23 2022] DELETE /identity/v3/projects/1e1faea0c5ec40e1af427d5f1431e750 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:23.609397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725f0fe-9813-4929-bec4-67450abca5d5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.609687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725f0fe-9813-4929-bec4-67450abca5d5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.609967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9725f0fe-9813-4929-bec4-67450abca5d5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.630484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9725f0fe-9813-4929-bec4-67450abca5d5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:23.631729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9725f0fe-9813-4929-bec4-67450abca5d5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:23.686949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] The token cache is being invalidate because project a773805e3e7842a4b8b365e7a71b1f08 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:23.687272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.688470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0fe0b62b-e7cf-4882-86c0-4d4946549c03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:23.691793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 913/1837] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:23 2022] DELETE /identity/v3/projects/a773805e3e7842a4b8b365e7a71b1f08 => generated 0 bytes in 485 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:23.696582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4f9f-2ef2-47a7-9b1e-e5499a0e69c9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.696896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4f9f-2ef2-47a7-9b1e-e5499a0e69c9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.697142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5aa4f9f-2ef2-47a7-9b1e-e5499a0e69c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.701776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 925/1838] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:23.711341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.711634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.711910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.732908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:23.734168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:23.736848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b5aa4f9f-2ef2-47a7-9b1e-e5499a0e69c9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:23.738016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b5aa4f9f-2ef2-47a7-9b1e-e5499a0e69c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:23.743139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 926/1839] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:23.747509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 914/1840] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:23.748424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.755756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.756053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.756338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.759087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c77b2184-7993-4b2c-a321-f2e674864950 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.764641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:23.764978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.765326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.765609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.766374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:23.766680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:23.768306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:23.776546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:23.778017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:23.780302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 927/1841] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:23.784601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.787645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 915/1842] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:23.791812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.796003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc06cf3-a4ed-4c20-83ee-1817c2765867 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.803171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:23.805300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.805887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.805887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.807579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab1cd6d3-d9c4-4ce5-90b2-7f13751d61ad None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.810173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:23.812482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:23.814187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:23.815569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.815856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.816296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.817377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:23.817688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:23.822652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:23.838131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 916/1843] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:23.839206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.856833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2571ff76-521d-49b0-ac40-90d8fbbb804d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.867202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:23.867950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:23.868244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:23.868542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:23.869831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:23.872466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:23.910724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 928/1844] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/projects => generated 377 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:16:23.915063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:23.995380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 917/1845] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/projects => generated 387 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:23.996765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8fe318e-db6b-4de7-9b53-9bfb8747b288 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:23.999345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.113514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.114231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.114513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.114799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.115477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.116198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866a3196-53c0-4719-a9d7-6a583fea32cc admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.117669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.122771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.124482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.124882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.125234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.126775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.130240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.191627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:24.197264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 929/1846] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/users => generated 289 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:24.201335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.213459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ad1d184-117e-4949-a06a-c12e83ca74ec admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.216922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.217588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.217873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.218306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.218971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.220567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.230784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 930/1847] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:24.234783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.244941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f791ea-1d6e-4c9d-986b-08011c0d4d47 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.249889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.250584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.259037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.259037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.259037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.259037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.259403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 918/1848] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:23 2022] POST /identity/v3/users => generated 294 bytes in 256 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:16:24.260301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.265857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 931/1849] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:24.270328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.271503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0372d7-9c06-4080-971c-f927985d3331 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.277324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.278361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.278715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.279200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.281594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:24.281852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.283899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.287374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4871a0f5-9a9a-4e67-9604-b745f3c62f91 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.298508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 919/1850] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:24.302906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.315264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d91661f-aa91-4fa8-8c45-070705d2283d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.315389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27bbaad-3355-45c2-9a4f-ed07408ae559 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.315507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91661f-aa91-4fa8-8c45-070705d2283d admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.315507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91661f-aa91-4fa8-8c45-070705d2283d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.315507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d91661f-aa91-4fa8-8c45-070705d2283d admin admin] PATH_INFO: `/v3/projects/9df6a4f7ad504f3fbcd98e362b6b1498/users/35bd0185ed1e4bbf97c227816af5fc14/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.320127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.320834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.321123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.321417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.322186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.323793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.336324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91661f-aa91-4fa8-8c45-070705d2283d admin admin] RBAC: Authorizing `identity:create_grant(project_id=9df6a4f7ad504f3fbcd98e362b6b1498, user_id=35bd0185ed1e4bbf97c227816af5fc14, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.342195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d91661f-aa91-4fa8-8c45-070705d2283d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.353033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 920/1851] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:24 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:24.353033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.353218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af9f6d4-fb8d-4870-b2bf-401439bb6a60 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.357826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a45106-38b7-4d5b-9bd3-07460e754edf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.358734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45106-38b7-4d5b-9bd3-07460e754edf admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.359023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45106-38b7-4d5b-9bd3-07460e754edf admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.359303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a45106-38b7-4d5b-9bd3-07460e754edf admin admin] PATH_INFO: `/v3/projects/f4be734fce344fef8d47f72474e2f4e4/users/f6326dfaa1f54f1b8213514ba0edf038/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.374998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a45106-38b7-4d5b-9bd3-07460e754edf admin admin] RBAC: Authorizing `identity:create_grant(project_id=f4be734fce344fef8d47f72474e2f4e4, user_id=f6326dfaa1f54f1b8213514ba0edf038, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.378374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a45106-38b7-4d5b-9bd3-07460e754edf admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.420048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 932/1852] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:24 2022] PUT /identity/v3/projects/9df6a4f7ad504f3fbcd98e362b6b1498/users/35bd0185ed1e4bbf97c227816af5fc14/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:24.430883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.431187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.431469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.464612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] MFA Rules not processed for user `35bd0185ed1e4bbf97c227816af5fc14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:24.465960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:24.471300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 921/1853] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:24 2022] PUT /identity/v3/projects/f4be734fce344fef8d47f72474e2f4e4/users/f6326dfaa1f54f1b8213514ba0edf038/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:24.482312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.482605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.482885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.511170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] MFA Rules not processed for user `f6326dfaa1f54f1b8213514ba0edf038`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:24.512630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:24.539926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 933/1854] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:24.551639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.555336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:24.593908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 922/1855] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:24 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:24.599080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.622245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a108fa0b-0318-4d1c-96dc-5d21d76ed88a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.626020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.626709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.627546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.627830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.638158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.639295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.650770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 934/1856] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:24 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:24.691200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-374e1e9d-8bb0-4b06-8961-a086aaf4616d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.696063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.696725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.697006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.697284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.697972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.700060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:24.831946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 923/1857] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:24 2022] POST /identity/v3/projects => generated 387 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:24.833421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:24.846594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-251ea571-896a-4669-8b4b-d1ad0bfc2658 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:24.916323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:24.917342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:24.917809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:24.918293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:24.919175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:24.921443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.135445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 935/1858] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:24 2022] POST /identity/v3/users => generated 294 bytes in 296 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:25.137878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.148668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d7793d-eb48-4726-8093-c9df5cf066c0 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.154171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:25.155223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.155746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.158824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.158824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:25.160277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.178144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 924/1859] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:25.179316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.190414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d97ee4-38fe-4bc6-b92b-fe64830a7cf5 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.195250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec110334-1464-4192-bec8-37f24513a422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:25.195978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec110334-1464-4192-bec8-37f24513a422 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.196191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec110334-1464-4192-bec8-37f24513a422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.196475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec110334-1464-4192-bec8-37f24513a422 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.197323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec110334-1464-4192-bec8-37f24513a422 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:25.198968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec110334-1464-4192-bec8-37f24513a422 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.215110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 936/1860] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:25.219071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.234569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75aa1960-efe5-42d8-bf8b-20f8d1202eec admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.239513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:25.243311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.244348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.244348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] PATH_INFO: `/v3/projects/1f2d6eae2d414d67a950f0ef1127f000/users/2a80c0012bd649c0bcbfc8bc391d1c14/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.268562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1f2d6eae2d414d67a950f0ef1127f000, user_id=2a80c0012bd649c0bcbfc8bc391d1c14, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:25.271463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.371500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 925/1861] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:25 2022] PUT /identity/v3/projects/1f2d6eae2d414d67a950f0ef1127f000/users/2a80c0012bd649c0bcbfc8bc391d1c14/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:25.376212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.376568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.381810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.390892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.394053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:25.408111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] MFA Rules not processed for user `2a80c0012bd649c0bcbfc8bc391d1c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:25.410311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:25.478070 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9701c1b4-812b-49cc-b2a2-f90dd9ac8a47 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.482818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:25.483683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.483959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.484232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] PATH_INFO: `/v3/users/575157441766495c91a171f495fa9988` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.485422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] RBAC: Authorizing `identity:delete_user(user_id=575157441766495c91a171f495fa9988)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:25.487734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.494327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 937/1862] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:25.495659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.509085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550625ab-8ed4-4a36-bf0a-5a991bbbfbe4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.514621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:25.515508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.515871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.516367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.517138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:25.519825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.695522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 938/1863] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:25 2022] POST /identity/v3/projects => generated 385 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:25.698904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.770429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '575157441766495c91a171f495fa9988'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:25.779983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '575157441766495c91a171f495fa9988'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:25.795729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '575157441766495c91a171f495fa9988'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:25.796630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '575157441766495c91a171f495fa9988'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:25.813922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-079e6452-c290-446f-8c0c-f3eefb851328 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.817215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:25.818018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.819261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.819393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.820208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:25.822338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:25.890408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c7e56c12-dd0b-4984-9916-9d6702a062fc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '575157441766495c91a171f495fa9988'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:25.897621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 926/1864] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:25 2022] DELETE /identity/v3/users/575157441766495c91a171f495fa9988 => generated 0 bytes in 507 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:25.902086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:25.902408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:25.902690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:25.921426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:25.922704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:25.923106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 939/1865] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:25 2022] POST /identity/v3/users => generated 299 bytes in 225 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:25.927041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:25.928746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:25.944339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef968ada-6368-48c8-b50d-8722a555f944 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:25.999871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 927/1866] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:26.009328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.010004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.010319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.010596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.011329 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.013135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.013952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:26.015361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:26.024168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 940/1867] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:25 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:26.028026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:26.038999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e867a026-e63c-4adc-bdde-9a9fb91894dc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:26.047276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.048296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.048585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.049176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] PATH_INFO: `/v3/projects/3739113f96564d908ac02705cdf78354/users/81d8c6fc5209447ab9ee18223a6651c8/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.065209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] RBAC: Authorizing `identity:create_grant(project_id=3739113f96564d908ac02705cdf78354, user_id=81d8c6fc5209447ab9ee18223a6651c8, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.067953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.076392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3614c9-857f-40e8-bcfa-fdc2b31d7f5b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:26.080850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.081526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.081768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.082062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.091653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.096553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.103621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 928/1868] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:26.148357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 941/1869] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:26 2022] PUT /identity/v3/projects/3739113f96564d908ac02705cdf78354/users/81d8c6fc5209447ab9ee18223a6651c8/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 121 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:26.152357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:26.164980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4d82c15-ec15-4d41-b70a-13832c4bf405 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:26.223142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cab2ad-c69e-4fa5-adbc-91177ff30569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.223915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab2ad-c69e-4fa5-adbc-91177ff30569 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.224276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab2ad-c69e-4fa5-adbc-91177ff30569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.224625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cab2ad-c69e-4fa5-adbc-91177ff30569 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.225427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab2ad-c69e-4fa5-adbc-91177ff30569 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.227127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cab2ad-c69e-4fa5-adbc-91177ff30569 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.240438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 929/1870] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:26 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:26.244124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:26.255935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-552589f4-b6fc-4e39-bd34-746d4a74c3ed admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:26.261743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.262740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.263029 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.263306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] PATH_INFO: `/v3/projects/3739113f96564d908ac02705cdf78354/users/81d8c6fc5209447ab9ee18223a6651c8/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.265383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3739113f96564d908ac02705cdf78354, user_id=81d8c6fc5209447ab9ee18223a6651c8, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.268752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.279316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 942/1871] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:26 2022] PUT /identity/v3/projects/3739113f96564d908ac02705cdf78354/users/81d8c6fc5209447ab9ee18223a6651c8/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:26.290414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.290909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.290998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.317885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] MFA Rules not processed for user `81d8c6fc5209447ab9ee18223a6651c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:26.319152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:26.363194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:26.389124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 930/1872] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:26 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:26.400177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:26.402070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:26.465039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-792d2875-d615-426d-b614-3348109c14e5 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:26.469033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.469884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.470200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.470478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.480419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.483209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.495605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 943/1873] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:26 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:26.511447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:26.729655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:26.732397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:26.810109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c27a2f3-d239-4342-aa9a-dafc197ffaa2 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:26.814720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:26.815592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:26.815864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:26.816147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] PATH_INFO: `/v3/projects/06ee0e2de7284b80a973b0ce46e7c36e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:26.817332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ee0e2de7284b80a973b0ce46e7c36e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:26.819282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:26.972138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ee0e2de7284b80a973b0ce46e7c36e', 'request_id': 'req-b2d389a7-7cd7-4010-b82a-f9bf071b217b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:26.980452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ee0e2de7284b80a973b0ce46e7c36e', 'request_id': 'req-b2d389a7-7cd7-4010-b82a-f9bf071b217b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:26.989137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ee0e2de7284b80a973b0ce46e7c36e', 'request_id': 'req-b2d389a7-7cd7-4010-b82a-f9bf071b217b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.110356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] The token cache is being invalidate because project 06ee0e2de7284b80a973b0ce46e7c36e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:27.110754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.111467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.113033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 931/1874] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:26 2022] DELETE /identity/v3/projects/06ee0e2de7284b80a973b0ce46e7c36e => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:27.117275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:27.128960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6433e4d1-ade4-449a-bbe2-47864cdddf6a service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:27.189032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:27.190445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:27.190729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:27.191007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] PATH_INFO: `/v3/users/0c2262adc501456a8784a941d748def3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:27.192389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c2262adc501456a8784a941d748def3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:27.194812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:27.221997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:27.332623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:27.435842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c2262adc501456a8784a941d748def3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.448528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c2262adc501456a8784a941d748def3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.455188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c2262adc501456a8784a941d748def3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.455894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c2262adc501456a8784a941d748def3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.562427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c2262adc501456a8784a941d748def3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.569994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 944/1875] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:27 2022] DELETE /identity/v3/users/0c2262adc501456a8784a941d748def3 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:27.584145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:27.585842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:27.598972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d389a7-7cd7-4010-b82a-f9bf071b217b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:27.676570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:27.678598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:27.678898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:27.679184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] PATH_INFO: `/v3/users/99fcc40dba0b44cfa271ec3efd906982` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:27.680631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=99fcc40dba0b44cfa271ec3efd906982)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:27.683236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:27.817521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:27.817521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:27.897043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02cf9a12-6684-4902-939c-06390a5a4248 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:27.900684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:27.901337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:27.901627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:27.901905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:27.904535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:27.920268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '99fcc40dba0b44cfa271ec3efd906982'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.928932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '99fcc40dba0b44cfa271ec3efd906982'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.947778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '99fcc40dba0b44cfa271ec3efd906982'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.950421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '99fcc40dba0b44cfa271ec3efd906982'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:27.973157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:27.974685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:27.983571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 945/1876] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:27 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 168 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:28.027089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4337056b-b218-42f3-8b23-d9e8450c84a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '99fcc40dba0b44cfa271ec3efd906982'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:28.034736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 932/1877] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:27 2022] DELETE /identity/v3/users/99fcc40dba0b44cfa271ec3efd906982 => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:28.035906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:28.038834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.040258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:28.041835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.042327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.075082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477626dc-4ad8-4bcc-86fc-5da53735b3aa service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:28.093234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:28.094547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:28.102157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:28.131934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:28.175180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:28.176184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.176478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.176762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] PATH_INFO: `/v3/projects/be024bb983bd4d2b8e4059b770779d8c` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.178047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be024bb983bd4d2b8e4059b770779d8c)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:28.180317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:28.196443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 933/1878] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:28.206750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:28.208234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:28.289735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66fc7430-ec6d-4c53-9925-229eccdb7e69 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:28.296054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea3728-093f-46dc-a691-21d77a100ee8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:28.296952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea3728-093f-46dc-a691-21d77a100ee8 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.297422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea3728-093f-46dc-a691-21d77a100ee8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.297877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea3728-093f-46dc-a691-21d77a100ee8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.312232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea3728-093f-46dc-a691-21d77a100ee8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:28.313700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13ea3728-093f-46dc-a691-21d77a100ee8 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:28.325176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 934/1879] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:28.343648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be024bb983bd4d2b8e4059b770779d8c', 'request_id': 'req-527b0e1f-2e2f-40ec-adf6-07048f419c63'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:28.350716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be024bb983bd4d2b8e4059b770779d8c', 'request_id': 'req-527b0e1f-2e2f-40ec-adf6-07048f419c63'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:28.357015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be024bb983bd4d2b8e4059b770779d8c', 'request_id': 'req-527b0e1f-2e2f-40ec-adf6-07048f419c63'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:28.460610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] The token cache is being invalidate because project be024bb983bd4d2b8e4059b770779d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:28.461118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:28.462351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-527b0e1f-2e2f-40ec-adf6-07048f419c63 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:28.464751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 946/1880] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:28 2022] DELETE /identity/v3/projects/be024bb983bd4d2b8e4059b770779d8c => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:28.469634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.469900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.470516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.505782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:28.507195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:28.878815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 935/1881] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:28.881848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.881848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.881848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.881848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:28.881848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:28.881848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 947/1882] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:28.883120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:28.883120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913982b3-f399-45ec-8f08-c86aaed7d212 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:28.883120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:28.883120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.884358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.884358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.884358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:28.884358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:28.884358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:28.884358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 936/1883] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:28.885021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:28.885021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a9bd2c2-aa52-4f54-a099-98acac63d3f0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:28.885021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:28.885021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:28.885439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:28.885439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:28.885439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:28.885439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:28.970399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 948/1884] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:28 2022] POST /identity/v3/projects => generated 407 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:28.981834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:28.993343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f61a0f11-1317-4bce-953a-8d83c145fabd admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.078061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.078757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.079137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.079491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.080772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.082759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.223375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 937/1885] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:28 2022] POST /identity/v3/users => generated 304 bytes in 226 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:29.223592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.230950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9433da78-20f4-4087-8d1d-af5bc515eab6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.248195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.249383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.250075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.250595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.251569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.253944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.271114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 949/1886] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:29.277367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.291101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a021ac3-7221-443c-8042-42d86c363ca6 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.299232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.301076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.301567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.302167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.303263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.305433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.343230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 938/1887] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:29 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:29.348101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.366751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a018b3f2-0ba2-4728-bf09-048543b2aa53 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.370975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.372888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2eceb3-aa1a-43a8-bb1b-816bff2820c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.373024 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:29.374107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eceb3-aa1a-43a8-bb1b-816bff2820c8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.374430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eceb3-aa1a-43a8-bb1b-816bff2820c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.374714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2eceb3-aa1a-43a8-bb1b-816bff2820c8 admin admin] PATH_INFO: `/v3/projects/488582b9bdb64e0a945af6b024088ec8/users/058f6ade20f64421a3e6a244f4f605f0/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.392375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eceb3-aa1a-43a8-bb1b-816bff2820c8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=488582b9bdb64e0a945af6b024088ec8, user_id=058f6ade20f64421a3e6a244f4f605f0, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.394984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85236d29-3c71-458e-be8b-4271bb0c11af admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.395868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2eceb3-aa1a-43a8-bb1b-816bff2820c8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.400284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.401402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.401750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.402134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] PATH_INFO: `/v3/projects/bad0f671b4a443b4b56b020770199188` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.403423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] RBAC: Authorizing `identity:delete_project(project_id=bad0f671b4a443b4b56b020770199188)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.405400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.519689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=87,keystone:INSERT=3,keystone:DELETE=10 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:29.558635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 950/1888] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:29 2022] PUT /identity/v3/projects/488582b9bdb64e0a945af6b024088ec8/users/058f6ade20f64421a3e6a244f4f605f0/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:29.570567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.571493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.571493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.579647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:29.604549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bad0f671b4a443b4b56b020770199188', 'request_id': 'req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:29.606786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] MFA Rules not processed for user `058f6ade20f64421a3e6a244f4f605f0`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:29.608294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:29.612982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bad0f671b4a443b4b56b020770199188', 'request_id': 'req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:29.624685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bad0f671b4a443b4b56b020770199188', 'request_id': 'req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:29.701821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 951/1889] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:29 2022] POST /identity/v3/auth/tokens => generated 3274 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:29.703228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.715214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] The token cache is being invalidate because project bad0f671b4a443b4b56b020770199188 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:29.721258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:29.721258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:29.721258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 939/1890] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:29 2022] DELETE /identity/v3/projects/bad0f671b4a443b4b56b020770199188 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:29.724865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.726659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:29.862595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b31dc-576a-416c-834a-19cb50a00ed2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.870094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.870805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087d1496-e2b7-47e0-92b2-4a2a4dafc43d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:29.871946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.873064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.873572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.874824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.875816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:29.876704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:29.877808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:29.878132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] PATH_INFO: `/v3/users/0c819ba1e26143b7901b3aa93c9b73fe` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:29.878988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.879586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] RBAC: Authorizing `identity:delete_user(user_id=0c819ba1e26143b7901b3aa93c9b73fe)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:29.883087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:29.984575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 952/1891] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:29 2022] POST /identity/v3/projects => generated 409 bytes in 282 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:29.989535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:29.992385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:30.079058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0424551e-3a8d-4c05-95f2-109797fa559f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:30.083969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:30.084586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:30.084858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:30.085272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:30.085971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:30.087925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:30.165806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0c819ba1e26143b7901b3aa93c9b73fe'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:30.181464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 953/1892] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:29 2022] POST /identity/v3/users => generated 311 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:30.183395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0c819ba1e26143b7901b3aa93c9b73fe'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:30.185470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:30.201789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f80c5c93-0875-452e-b57a-3a4a66155504 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:30.214684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0c819ba1e26143b7901b3aa93c9b73fe'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:30.214859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:30.215784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:30.216142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0c819ba1e26143b7901b3aa93c9b73fe'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:30.216664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:30.217096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:30.218145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:30.220450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:30.233079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 954/1893] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:30.237697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:30.247841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af736950-e967-4a43-8ba3-dd18e0eea333 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:30.261901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:30.261901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:30.261901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:30.261901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] PATH_INFO: `/v3/projects/8436780fef1049769ea5846434239fe2/users/cd437342906b4b17b48307fb40c4a829/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:30.285576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] RBAC: Authorizing `identity:create_grant(project_id=8436780fef1049769ea5846434239fe2, user_id=cd437342906b4b17b48307fb40c4a829, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:30.288474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:30.296605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0c819ba1e26143b7901b3aa93c9b73fe'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:30.305034 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 940/1894] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:29 2022] DELETE /identity/v3/users/0c819ba1e26143b7901b3aa93c9b73fe => generated 0 bytes in 581 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:30.378295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 955/1895] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:30 2022] PUT /identity/v3/projects/8436780fef1049769ea5846434239fe2/users/cd437342906b4b17b48307fb40c4a829/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 141 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:30.382588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:30.384687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:30.503640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdebe92-5e4f-4d68-986f-384c2bcfc42b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:30.595190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef63cf7a-9ccf-4fb1-a450-e2712cd978b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:30.596746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cf7a-9ccf-4fb1-a450-e2712cd978b5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:30.597131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cf7a-9ccf-4fb1-a450-e2712cd978b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:30.597465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef63cf7a-9ccf-4fb1-a450-e2712cd978b5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:30.598809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cf7a-9ccf-4fb1-a450-e2712cd978b5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:30.601085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef63cf7a-9ccf-4fb1-a450-e2712cd978b5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:30.620707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 941/1896] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:30 2022] GET /identity/v3/roles => generated 1420 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:30.623286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:30.638285 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbb9909a-e946-4ad0-b3a2-7128d49be16d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:30.645499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:30.646755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:30.647117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:30.647420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] PATH_INFO: `/v3/projects/8436780fef1049769ea5846434239fe2/users/cd437342906b4b17b48307fb40c4a829/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:30.649818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8436780fef1049769ea5846434239fe2, user_id=cd437342906b4b17b48307fb40c4a829, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:30.656104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:30.686475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 956/1897] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:30 2022] PUT /identity/v3/projects/8436780fef1049769ea5846434239fe2/users/cd437342906b4b17b48307fb40c4a829/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:30.689063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:30.689699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:30.690247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:30.743006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] MFA Rules not processed for user `cd437342906b4b17b48307fb40c4a829`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:30.745350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:30.827396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:30.828900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:30.883459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 942/1898] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:30 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:30.907758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:30.907758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:31.008110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4785a1c0-002e-4326-a86b-0546ffe294be None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:31.013912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4878eda7-0157-4d23-889d-2b13164a9c07 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:31.014886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878eda7-0157-4d23-889d-2b13164a9c07 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.015254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878eda7-0157-4d23-889d-2b13164a9c07 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.015532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4878eda7-0157-4d23-889d-2b13164a9c07 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.016063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:31.031408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878eda7-0157-4d23-889d-2b13164a9c07 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:31.031649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8faba86-2648-4b25-ba67-af0674eb2037 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:31.039451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:31.041051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.041773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.042138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] PATH_INFO: `/v3/projects/9cf340f762164f349ac4ee10a2f5dc40` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.044412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9cf340f762164f349ac4ee10a2f5dc40)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:31.054257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4878eda7-0157-4d23-889d-2b13164a9c07 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:31.054408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:31.062487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 943/1899] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:30 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:31.227696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9cf340f762164f349ac4ee10a2f5dc40', 'request_id': 'req-50401f6a-49d3-46e6-8456-35eaa78ea570'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:31.238793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9cf340f762164f349ac4ee10a2f5dc40', 'request_id': 'req-50401f6a-49d3-46e6-8456-35eaa78ea570'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:31.246593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9cf340f762164f349ac4ee10a2f5dc40', 'request_id': 'req-50401f6a-49d3-46e6-8456-35eaa78ea570'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:31.349485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] The token cache is being invalidate because project 9cf340f762164f349ac4ee10a2f5dc40 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:31.350193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:31.351189 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50401f6a-49d3-46e6-8456-35eaa78ea570 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:31.358621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 957/1900] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:30 2022] DELETE /identity/v3/projects/9cf340f762164f349ac4ee10a2f5dc40 => generated 0 bytes in 528 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:31.360255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.360644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.361047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.401473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:31.404922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:31.525564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 944/1901] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:31.535635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.535933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.536218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.575637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:31.579037 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:31.595014 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 958/1902] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:31.595348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:31.606998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd1700a0-bd23-4d2b-b6d8-15da9d65e644 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:31.613965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:31.614867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.615229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.615571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.616382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:31.617255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:31.619311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:31.637749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 945/1903] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:31.641821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:31.654349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1331e409-f983-4fd3-b292-53c7b5c5c396 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:31.659864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:31.660546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.660832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.661112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.661917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:31.667050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:31.670005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:31.732732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:31.738847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:31.767420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 959/1904] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:31 2022] POST /identity/v3/projects => generated 363 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:16:31.771810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:31.871655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce3e025-76e2-42c4-874a-5e6253decc7c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:31.886787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9823a0f4-ff39-4cbb-90f8-21e591b24e00 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:31.899736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:31.900586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.900967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.901376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.902500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:31.907856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:31.964011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:31.965843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:31.966722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:31.968500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:31.972035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:32.042195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 960/1905] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:31 2022] POST /identity/v3/users => generated 282 bytes in 268 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:32.044269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:32.059739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4321d696-5c04-4362-b030-0e508fa1f07c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:32.077610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:32.083464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:32.085734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:32.086469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:32.086872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:32.087148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:32.087902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:32.089629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:32.109248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 946/1906] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:31 2022] GET /identity/v3/auth/tokens => generated 3274 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:32.113459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 961/1907] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 69 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:32.117064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:32.137259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2274877-419d-4c38-bd93-7179cd40acf3 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:32.152648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8572d70-f81c-4980-a588-e310034bc139 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:32.153483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8572d70-f81c-4980-a588-e310034bc139 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:32.153772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8572d70-f81c-4980-a588-e310034bc139 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:32.156609 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8572d70-f81c-4980-a588-e310034bc139 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:32.157577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8572d70-f81c-4980-a588-e310034bc139 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:32.163736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8572d70-f81c-4980-a588-e310034bc139 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:32.192887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 947/1908] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:32 2022] GET /identity/v3/roles => generated 1420 bytes in 74 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:32.197052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:32.225208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f760853f-17c4-4be4-b4ac-01e07ac40fcf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:32.240803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:32.243551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:32.243941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:32.254508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] PATH_INFO: `/v3/projects/73caa77a027246b794162009b01b1f4e/users/c3cc9ea03936468888b14c318f047acb/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:32.276443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] RBAC: Authorizing `identity:create_grant(project_id=73caa77a027246b794162009b01b1f4e, user_id=c3cc9ea03936468888b14c318f047acb, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:32.281043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:32.382514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 962/1909] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:32 2022] PUT /identity/v3/projects/73caa77a027246b794162009b01b1f4e/users/c3cc9ea03936468888b14c318f047acb/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:32.388973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:32.389302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:32.389581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:32.423648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] MFA Rules not processed for user `c3cc9ea03936468888b14c318f047acb`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:32.425797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:32.538768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 948/1910] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:32 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:32.550523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:32.625430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:32.663050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be7612e0-507d-4f95-ab6f-621e5e8f84bd admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:32.672629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:32.673360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:32.673684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:32.677290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:32.677290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:32.688294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:32.695956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:32.827973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 963/1911] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:32 2022] POST /identity/v3/projects => generated 365 bytes in 275 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:32.829342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:32.846669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599362f4-2f5d-44be-a2f5-73cb5b05642e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:32.919389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:32.923555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:32.923555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:32.923555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:32.923555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:32.924237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:33.167460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 949/1912] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:32 2022] POST /identity/v3/users => generated 289 bytes in 293 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:33.168269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:33.168269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef8f55e-9d75-43eb-9a3c-82208aa0f389 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:33.168269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:33.168269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.168903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.168903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:33.168903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:33.168903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:33.174086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 964/1913] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:33.177175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:33.187302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42ecb145-90cd-4535-ab0d-91466e7a1a88 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:33.192617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:33.193497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.193779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.199050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] PATH_INFO: `/v3/projects/9dc7a6ae02d24185b40f7d4d1685f0dd/users/5058068cd87f47d4bea168fd4eb298c7/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:33.209343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc7a6ae02d24185b40f7d4d1685f0dd, user_id=5058068cd87f47d4bea168fd4eb298c7, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:33.212027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:33.278472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 950/1914] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:33 2022] PUT /identity/v3/projects/9dc7a6ae02d24185b40f7d4d1685f0dd/users/5058068cd87f47d4bea168fd4eb298c7/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:33.283411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:33.293873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652f05fc-aa1d-4b07-aab8-48af674bf53f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:33.350648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c3f233-2bf6-456b-a2f0-e6ca71124e8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:33.351322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f233-2bf6-456b-a2f0-e6ca71124e8b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.351608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f233-2bf6-456b-a2f0-e6ca71124e8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.351879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c3f233-2bf6-456b-a2f0-e6ca71124e8b admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:33.352674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f233-2bf6-456b-a2f0-e6ca71124e8b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:33.354305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c3f233-2bf6-456b-a2f0-e6ca71124e8b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:33.364640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 965/1915] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:33 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:33.369191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:33.379919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ae95f4-9d9d-4390-8f19-42ffe5122896 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:33.385546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:33.390124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.390124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.390124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] PATH_INFO: `/v3/projects/9dc7a6ae02d24185b40f7d4d1685f0dd/users/5058068cd87f47d4bea168fd4eb298c7/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:33.391606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] RBAC: Authorizing `identity:create_grant(project_id=9dc7a6ae02d24185b40f7d4d1685f0dd, user_id=5058068cd87f47d4bea168fd4eb298c7, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:33.396657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:33.411202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 951/1916] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:33 2022] PUT /identity/v3/projects/9dc7a6ae02d24185b40f7d4d1685f0dd/users/5058068cd87f47d4bea168fd4eb298c7/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:33.422581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.423562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.425055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:33.456923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] MFA Rules not processed for user `5058068cd87f47d4bea168fd4eb298c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:33.458245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:33.532334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 966/1917] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:33 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:33.588522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:33.592458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:33.650530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea004389-3141-451f-8b7b-d0ea4b78dc1c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:33.654462 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:33.655148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.655471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.655760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:33.665128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:33.666601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:33.683760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 952/1918] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:33.971979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:33.981570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d88d2c-6195-471d-b34a-67cc4527ef77 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:33.985236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:33.985884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:33.990432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:33.990432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:34.043993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:34.045415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:34.054953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 967/1919] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:33 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:34.143682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:34.152301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70374423-d990-4f8e-ba67-14a2b314507f service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:34.155912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:34.156657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:34.156946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:34.157223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:34.158996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:34.217701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:34.219182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65d0b5c4-bf04-4b8c-9ae2-85784170675c service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:34.228156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 953/1920] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:34 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:35.614350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:35.787336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:37.209100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:37.264965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:37.759157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=86,keystone:INSERT=7,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:38.019981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:38.067654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:38.132082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c7d6ae-895c-413c-b68b-1a3d69d29248 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:38.136643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:38.137569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:38.137883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:38.138217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] PATH_INFO: `/v3/users/c3cc9ea03936468888b14c318f047acb` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:38.139354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c3cc9ea03936468888b14c318f047acb)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:38.141341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:38.384731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c3cc9ea03936468888b14c318f047acb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:38.400388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c3cc9ea03936468888b14c318f047acb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:38.426106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c3cc9ea03936468888b14c318f047acb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:38.426876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c3cc9ea03936468888b14c318f047acb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:38.496477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c3cc9ea03936468888b14c318f047acb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:38.504678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 968/1921] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:38 2022] DELETE /identity/v3/users/c3cc9ea03936468888b14c318f047acb => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:38.509066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:38.509572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:38.509749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:38.530107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:38.531295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:38.591806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 954/1922] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:38.602467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:38.603884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:38.660525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50f36ee4-a0eb-4ed3-8435-226d5ba87b53 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:38.664192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:38.664851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:38.665132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:38.665407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:38.675365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:38.677067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:38.688103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 969/1923] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:38.859449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:38.983101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:38.983917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:38.996313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e398ea0-39fd-441b-893a-f354bb009c20 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:39.002529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:39.003407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:39.003689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:39.003962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] PATH_INFO: `/v3/users/f6326dfaa1f54f1b8213514ba0edf038` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:39.005907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] RBAC: Authorizing `identity:delete_user(user_id=f6326dfaa1f54f1b8213514ba0edf038)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:39.008030 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:39.173487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:39.211639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:39.213186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:39.231362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fb9b683-52c0-4933-aba3-9e630ec5c290 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:39.239897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f6326dfaa1f54f1b8213514ba0edf038'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.244910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:39.246006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:39.246316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:39.246594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] PATH_INFO: `/v3/projects/73caa77a027246b794162009b01b1f4e` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:39.251032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=73caa77a027246b794162009b01b1f4e)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:39.253685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:39.257832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f6326dfaa1f54f1b8213514ba0edf038'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.285696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f6326dfaa1f54f1b8213514ba0edf038'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.287327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f6326dfaa1f54f1b8213514ba0edf038'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.388347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4346116f-f5bf-4483-b9c2-f4e1c8e963fb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f6326dfaa1f54f1b8213514ba0edf038'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.400728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 955/1924] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:38 2022] DELETE /identity/v3/users/f6326dfaa1f54f1b8213514ba0edf038 => generated 0 bytes in 417 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:39.402384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:39.402959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:39.403433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:39.428596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:39.430759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:39.431316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '73caa77a027246b794162009b01b1f4e', 'request_id': 'req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.450806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '73caa77a027246b794162009b01b1f4e', 'request_id': 'req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.450806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '73caa77a027246b794162009b01b1f4e', 'request_id': 'req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.509744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 956/1925] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:39.522978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:39.524654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:39.589935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b1802a-cede-48d3-950a-a63ca8425474 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:39.595236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:39.600399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:39.600399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:39.600399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:39.600655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] The token cache is being invalidate because project 73caa77a027246b794162009b01b1f4e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:39.600655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.600842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.602459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 970/1926] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:39 2022] DELETE /identity/v3/projects/73caa77a027246b794162009b01b1f4e => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:39.606191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:39.608458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:39.608840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:39.610439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:39.623028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 957/1927] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:39.686396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-062ecf8b-1934-43ac-b1f3-e7ec4cf3dba5 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:39.686396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:39.687041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:39.687396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:39.687749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] PATH_INFO: `/v3/users/5058068cd87f47d4bea168fd4eb298c7` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:39.689020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5058068cd87f47d4bea168fd4eb298c7)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:39.691597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:39.836752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:39.876590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5058068cd87f47d4bea168fd4eb298c7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.889538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5058068cd87f47d4bea168fd4eb298c7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.897783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5058068cd87f47d4bea168fd4eb298c7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.897969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5058068cd87f47d4bea168fd4eb298c7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:39.916400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:40.004090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5058068cd87f47d4bea168fd4eb298c7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.012689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 971/1928] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:39 2022] DELETE /identity/v3/users/5058068cd87f47d4bea168fd4eb298c7 => generated 0 bytes in 407 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:40.139382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:40.141265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:40.157075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dbbfe0c-7395-491c-a850-fbab5fca3d99 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:40.174456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:40.176889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:40.259171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:40.260052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:40.260337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:40.260626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] PATH_INFO: `/v3/projects/f4be734fce344fef8d47f72474e2f4e4` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:40.261825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f4be734fce344fef8d47f72474e2f4e4)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:40.263990 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:40.290064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b2f071-d549-4fb9-add5-f2cf390594ad admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:40.296077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:40.296972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:40.297340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:40.297603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] PATH_INFO: `/v3/users/058f6ade20f64421a3e6a244f4f605f0` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:40.299504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] RBAC: Authorizing `identity:delete_user(user_id=058f6ade20f64421a3e6a244f4f605f0)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:40.301482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:40.301614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:40.369999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f4be734fce344fef8d47f72474e2f4e4', 'request_id': 'req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.375914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f4be734fce344fef8d47f72474e2f4e4', 'request_id': 'req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.382892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f4be734fce344fef8d47f72474e2f4e4', 'request_id': 'req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.450825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] The token cache is being invalidate because project f4be734fce344fef8d47f72474e2f4e4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:40.451203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.452099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.454176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 958/1929] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:40 2022] DELETE /identity/v3/projects/f4be734fce344fef8d47f72474e2f4e4 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:40.457935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:40.462855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:40.526917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81e8f26b-32ae-47c4-bc8a-7f32d7eb69c1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:40.531941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:40.532636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '058f6ade20f64421a3e6a244f4f605f0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.533566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:40.533891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:40.534359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] PATH_INFO: `/v3/users/2a80c0012bd649c0bcbfc8bc391d1c14` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:40.535596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a80c0012bd649c0bcbfc8bc391d1c14)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:40.538254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:40.560617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:40.563529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '058f6ade20f64421a3e6a244f4f605f0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.573089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '058f6ade20f64421a3e6a244f4f605f0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.574247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '058f6ade20f64421a3e6a244f4f605f0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.626966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '058f6ade20f64421a3e6a244f4f605f0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.633495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 972/1930] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:40 2022] DELETE /identity/v3/users/058f6ade20f64421a3e6a244f4f605f0 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:40.638111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:40.638111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:40.698080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae78a7a-7ae0-4409-b033-c0558b1ba21a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:40.703045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:40.703877 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:40.704150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:40.704427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] PATH_INFO: `/v3/projects/9dc7a6ae02d24185b40f7d4d1685f0dd` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:40.706481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9dc7a6ae02d24185b40f7d4d1685f0dd)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:40.708406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:40.721633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a80c0012bd649c0bcbfc8bc391d1c14'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.729000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a80c0012bd649c0bcbfc8bc391d1c14'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.741137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a80c0012bd649c0bcbfc8bc391d1c14'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.744322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a80c0012bd649c0bcbfc8bc391d1c14'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.851097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d528d15b-d721-45b6-9534-9861fc98cae5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a80c0012bd649c0bcbfc8bc391d1c14'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.859701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 959/1931] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:40 2022] DELETE /identity/v3/users/2a80c0012bd649c0bcbfc8bc391d1c14 => generated 0 bytes in 402 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:40.862203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:40.862645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:40.863177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:40.874856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9dc7a6ae02d24185b40f7d4d1685f0dd', 'request_id': 'req-42d31960-1f1b-49eb-8952-bbe5a0670dd7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.881380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9dc7a6ae02d24185b40f7d4d1685f0dd', 'request_id': 'req-42d31960-1f1b-49eb-8952-bbe5a0670dd7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.887927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:40.888767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9dc7a6ae02d24185b40f7d4d1685f0dd', 'request_id': 'req-42d31960-1f1b-49eb-8952-bbe5a0670dd7'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.889604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:40.959056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 960/1932] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:40.969235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:40.970348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] The token cache is being invalidate because project 9dc7a6ae02d24185b40f7d4d1685f0dd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:40.974096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.974228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:40.974320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-42d31960-1f1b-49eb-8952-bbe5a0670dd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:40.978073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 973/1933] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:40 2022] DELETE /identity/v3/projects/9dc7a6ae02d24185b40f7d4d1685f0dd => generated 0 bytes in 341 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:40.979295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822b1c-1919-40ea-8467-9e0465e85577 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:40.979689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822b1c-1919-40ea-8467-9e0465e85577 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:40.979905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05822b1c-1919-40ea-8467-9e0465e85577 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.000299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-05822b1c-1919-40ea-8467-9e0465e85577 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:41.001513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-05822b1c-1919-40ea-8467-9e0465e85577 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.009929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 974/1934] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:41.018011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.018328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.018608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.036785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:41.037998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.039875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b9aae87-401e-4bf0-83a5-3fee68812a3e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.043627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.044501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.044598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.044851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.046510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 975/1935] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:41.046634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.050420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.058878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.059617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1d012fd-ac2d-439c-a13c-6b0560633329 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.060291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.064696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.065505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.065505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.065749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.066527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:41.066816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.068823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.070362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 961/1936] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:41.086009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 976/1937] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:41.090365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.105293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5d7b301-8897-4747-a48f-39e83df4beb6 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.110760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.111273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.111563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.112048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.112804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.115002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.207260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 962/1938] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:41 2022] POST /identity/v3/projects => generated 385 bytes in 114 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:41.208619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.219052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f51d31-5bfc-4767-b867-6a7a041c00bf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.277124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:41.277900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.278622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.278960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.279235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.279925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.281840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.376032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.378357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.378529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 977/1939] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:41 2022] POST /identity/v3/users => generated 293 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:41.383345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.396935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c7b0c66-adf6-43d0-ab1c-1d9a64f76ab3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.404237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.405062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.405545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.405908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.406771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.407839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c86f05c3-c628-4c48-aa7e-2209692456c7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.409421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.414923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.415924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.416274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.416618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] PATH_INFO: `/v3/projects/1f2d6eae2d414d67a950f0ef1127f000` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.418056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] RBAC: Authorizing `identity:delete_project(project_id=1f2d6eae2d414d67a950f0ef1127f000)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.420596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.425120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 978/1940] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:41.430773 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.441574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148cf669-a676-4497-92e5-1340bfc57262 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.446918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.448190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.448768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.449364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.450788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.454322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.472604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 979/1941] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:41 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:41.476557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.486154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-827d9613-2af5-4147-9701-a6e0a310acee admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.490671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.491596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.492142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.492411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] PATH_INFO: `/v3/projects/e09f5aa47bca47309d0dce9d5864ac37/users/37848771c61a46f98f000203a3afe51d/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.507074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e09f5aa47bca47309d0dce9d5864ac37, user_id=37848771c61a46f98f000203a3afe51d, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.513438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.577592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 980/1942] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:41 2022] PUT /identity/v3/projects/e09f5aa47bca47309d0dce9d5864ac37/users/37848771c61a46f98f000203a3afe51d/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:41.578482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.585777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.594216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1f2d6eae2d414d67a950f0ef1127f000', 'request_id': 'req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.600399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1f2d6eae2d414d67a950f0ef1127f000', 'request_id': 'req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.607476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1f2d6eae2d414d67a950f0ef1127f000', 'request_id': 'req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.660873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffa9fef-d6f4-4b01-b6bd-b5020dd81a6c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.695683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] The token cache is being invalidate because project 1f2d6eae2d414d67a950f0ef1127f000 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:41.697144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.697144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10f7eddf-08e4-4cf3-ac3a-d086c11cec7b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.705611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 963/1943] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:41 2022] DELETE /identity/v3/projects/1f2d6eae2d414d67a950f0ef1127f000 => generated 0 bytes in 324 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:41.707407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.707705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.707992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.744565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.745495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.745784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.746395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] PATH_INFO: `/v3/projects/488582b9bdb64e0a945af6b024088ec8` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.748425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] RBAC: Authorizing `identity:delete_project(project_id=488582b9bdb64e0a945af6b024088ec8)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.749476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.761659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] MFA Rules not processed for user `37848771c61a46f98f000203a3afe51d`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:41.764738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.834660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 964/1944] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:41 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:41.835580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.836863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:41.850101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6411f901-72d4-426e-ad74-a535ffc7ff92 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:41.858266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '488582b9bdb64e0a945af6b024088ec8', 'request_id': 'req-ca9298cd-26c2-4ddf-ab1a-0b319871b679'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.864433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '488582b9bdb64e0a945af6b024088ec8', 'request_id': 'req-ca9298cd-26c2-4ddf-ab1a-0b319871b679'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.872254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:41.873024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '488582b9bdb64e0a945af6b024088ec8', 'request_id': 'req-ca9298cd-26c2-4ddf-ab1a-0b319871b679'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.907272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:41.908225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:41.908571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:41.908863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] PATH_INFO: `/v3/users/81d8c6fc5209447ab9ee18223a6651c8` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:41.910093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] RBAC: Authorizing `identity:delete_user(user_id=81d8c6fc5209447ab9ee18223a6651c8)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:41.912083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:41.987187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] The token cache is being invalidate because project 488582b9bdb64e0a945af6b024088ec8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:41.987187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.987187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:41.987187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 981/1945] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:41 2022] DELETE /identity/v3/projects/488582b9bdb64e0a945af6b024088ec8 => generated 0 bytes in 409 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:41.988392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:41.990162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.005995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9298cd-26c2-4ddf-ab1a-0b319871b679 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.008811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.009745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.010047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.010332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] PATH_INFO: `/v3/users/35bd0185ed1e4bbf97c227816af5fc14` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.011659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] RBAC: Authorizing `identity:delete_user(user_id=35bd0185ed1e4bbf97c227816af5fc14)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.013726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.130055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '81d8c6fc5209447ab9ee18223a6651c8'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.136868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '81d8c6fc5209447ab9ee18223a6651c8'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.148439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '81d8c6fc5209447ab9ee18223a6651c8'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.149105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '81d8c6fc5209447ab9ee18223a6651c8'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.188828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '35bd0185ed1e4bbf97c227816af5fc14'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.202114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '35bd0185ed1e4bbf97c227816af5fc14'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.208946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '35bd0185ed1e4bbf97c227816af5fc14'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.209419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '81d8c6fc5209447ab9ee18223a6651c8'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.209687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '35bd0185ed1e4bbf97c227816af5fc14'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.216223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 965/1946] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:41 2022] DELETE /identity/v3/users/81d8c6fc5209447ab9ee18223a6651c8 => generated 0 bytes in 381 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:42.217029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.218426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.266901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '35bd0185ed1e4bbf97c227816af5fc14'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.274463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 982/1947] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:41 2022] DELETE /identity/v3/users/35bd0185ed1e4bbf97c227816af5fc14 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:42.275771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.277313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.285390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b86919-244a-4cc7-be91-3b630bc74e3d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.349372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6729ab-c0ae-4b92-9294-734ba577f860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.350095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6729ab-c0ae-4b92-9294-734ba577f860 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.350516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6729ab-c0ae-4b92-9294-734ba577f860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.356378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6729ab-c0ae-4b92-9294-734ba577f860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.356378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6729ab-c0ae-4b92-9294-734ba577f860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.356564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1b9ca6-ea9e-48bf-82b6-971bdd29b476 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.356644 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6729ab-c0ae-4b92-9294-734ba577f860 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.358429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.359300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.359584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.359864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] PATH_INFO: `/v3/users/cd437342906b4b17b48307fb40c4a829` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.361655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd437342906b4b17b48307fb40c4a829)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.363649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.375486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:42.463541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 966/1948] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:42 2022] POST /identity/v3/projects => generated 385 bytes in 247 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:42.465542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.465911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.466376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.489629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:42.489629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.545893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd437342906b4b17b48307fb40c4a829'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.556556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 967/1949] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:42.557308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.558853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.565858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd437342906b4b17b48307fb40c4a829'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.575343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd437342906b4b17b48307fb40c4a829'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.576143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd437342906b4b17b48307fb40c4a829'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.577332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972d5e87-84d8-4e0b-9d51-d36da66da771 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.583215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.587001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.587001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.587001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.587001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.587277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.661271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd437342906b4b17b48307fb40c4a829'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.667754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 983/1950] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:42 2022] DELETE /identity/v3/users/cd437342906b4b17b48307fb40c4a829 => generated 0 bytes in 393 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:42.668530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.669840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.701064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 968/1951] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:42 2022] POST /identity/v3/users => generated 299 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:42.705610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.714194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.732360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f237e-2300-436f-8f77-ee62f80a6aa9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.740219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9f1e96-b511-45b1-9a4a-29b25644f385 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.744967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.745685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.745981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.746372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.748229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.796357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.797237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.797523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.797802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] PATH_INFO: `/v3/projects/3739113f96564d908ac02705cdf78354` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.799056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] RBAC: Authorizing `identity:delete_project(project_id=3739113f96564d908ac02705cdf78354)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.800989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.820148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.821682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.832120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 984/1952] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:42.834135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.835536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:42.847293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ffe41ac-902f-4f0f-a4ce-2c30843481f1 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.852156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.852815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.853102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.853379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.854137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.855725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.866051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 985/1953] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:42 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:42.870575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:42.881071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6963d5-1b27-44ea-8e0a-7b74a1ecfe72 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:42.885977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:42.886919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:42.887196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:42.887472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] PATH_INFO: `/v3/projects/7242802e630d4ef8a4c139ac97bf9093/users/ddce3053869e4957a07320e98cf4f92c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:42.903609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7242802e630d4ef8a4c139ac97bf9093, user_id=ddce3053869e4957a07320e98cf4f92c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:42.910872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:42.921075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3739113f96564d908ac02705cdf78354', 'request_id': 'req-0e51d431-12d4-4f90-beab-27a2cf1f621c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.926947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3739113f96564d908ac02705cdf78354', 'request_id': 'req-0e51d431-12d4-4f90-beab-27a2cf1f621c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:42.942831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3739113f96564d908ac02705cdf78354', 'request_id': 'req-0e51d431-12d4-4f90-beab-27a2cf1f621c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.079420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] The token cache is being invalidate because project 3739113f96564d908ac02705cdf78354 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:43.080405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.081161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 986/1954] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:42 2022] PUT /identity/v3/projects/7242802e630d4ef8a4c139ac97bf9093/users/ddce3053869e4957a07320e98cf4f92c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:43.083991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e51d431-12d4-4f90-beab-27a2cf1f621c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.085012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.086510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 969/1955] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:42 2022] DELETE /identity/v3/projects/3739113f96564d908ac02705cdf78354 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:43.087952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.092038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.092421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.092932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.121550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:43.123442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.159430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:43.173080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa53cbc-6b18-4e23-b8d9-1c562661db87 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.185711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.185711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.185711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.185711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.187112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.188806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.204036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 987/1956] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:43 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:43.205143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.207150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.221316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-993b3424-f011-484a-aacb-9838cc0fd0c6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.234749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.234749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.234749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.234749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] PATH_INFO: `/v3/projects/8436780fef1049769ea5846434239fe2` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.236606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] RBAC: Authorizing `identity:delete_project(project_id=8436780fef1049769ea5846434239fe2)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.236606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.261296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 970/1957] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:43.261296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.272857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36496b32-e146-4d36-af54-bdb93bef2004 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.278297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bf33a00-3ae3-426e-abd8-ff0a672b1693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.279590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33a00-3ae3-426e-abd8-ff0a672b1693 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.279590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33a00-3ae3-426e-abd8-ff0a672b1693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.279856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bf33a00-3ae3-426e-abd8-ff0a672b1693 admin admin] PATH_INFO: `/v3/projects/7242802e630d4ef8a4c139ac97bf9093/users/ddce3053869e4957a07320e98cf4f92c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.281842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf33a00-3ae3-426e-abd8-ff0a672b1693 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7242802e630d4ef8a4c139ac97bf9093, user_id=ddce3053869e4957a07320e98cf4f92c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.284731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bf33a00-3ae3-426e-abd8-ff0a672b1693 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.301738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 971/1958] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:43 2022] PUT /identity/v3/projects/7242802e630d4ef8a4c139ac97bf9093/users/ddce3053869e4957a07320e98cf4f92c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:43.303138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd64f-a055-4419-8589-459e32901b02 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.303448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd64f-a055-4419-8589-459e32901b02 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.303720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-566bd64f-a055-4419-8589-459e32901b02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.329829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-566bd64f-a055-4419-8589-459e32901b02 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:43.331082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-566bd64f-a055-4419-8589-459e32901b02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.422278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8436780fef1049769ea5846434239fe2', 'request_id': 'req-0372f168-3d95-4642-8989-f482ac18a8ce'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.428675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 972/1959] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:43.430072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.430360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.430642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.436836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8436780fef1049769ea5846434239fe2', 'request_id': 'req-0372f168-3d95-4642-8989-f482ac18a8ce'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.450186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8436780fef1049769ea5846434239fe2', 'request_id': 'req-0372f168-3d95-4642-8989-f482ac18a8ce'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.488033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] MFA Rules not processed for user `ddce3053869e4957a07320e98cf4f92c`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:43.490480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.541928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] The token cache is being invalidate because project 8436780fef1049769ea5846434239fe2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:43.542281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.543276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.544936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 988/1960] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:43 2022] DELETE /identity/v3/projects/8436780fef1049769ea5846434239fe2 => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:43.545974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.546845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.577753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 973/1961] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:43.578675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.584282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.629896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372f168-3d95-4642-8989-f482ac18a8ce admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.636577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.638344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.638819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.639365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] PATH_INFO: `/v3/projects/9df6a4f7ad504f3fbcd98e362b6b1498` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.641429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] RBAC: Authorizing `identity:delete_project(project_id=9df6a4f7ad504f3fbcd98e362b6b1498)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.644458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.658346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f27503a5-ff23-458d-a81e-a9e575d9a1f9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.663648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.664518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.664906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.665190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.666054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:43.666374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.668006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4020a7a5-c808-4c90-a5f6-402c9e05841c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.678972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:43.682631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 974/1962] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:43.683695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.683984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.684263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.702297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:43.710901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.711382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 975/1963] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:43.712162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.713385 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.770795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-defaa044-ea67-46f5-a579-c5a981911411 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.784480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9df6a4f7ad504f3fbcd98e362b6b1498', 'request_id': 'req-737b9d26-7b2b-414e-a910-42c550e3e715'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.791481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9df6a4f7ad504f3fbcd98e362b6b1498', 'request_id': 'req-737b9d26-7b2b-414e-a910-42c550e3e715'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.799418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9df6a4f7ad504f3fbcd98e362b6b1498', 'request_id': 'req-737b9d26-7b2b-414e-a910-42c550e3e715'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.822569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8288b200-4283-45b6-b930-b968524a560f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.823308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b200-4283-45b6-b930-b968524a560f service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.823590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b200-4283-45b6-b930-b968524a560f service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.823869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8288b200-4283-45b6-b930-b968524a560f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.880828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] The token cache is being invalidate because project 9df6a4f7ad504f3fbcd98e362b6b1498 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:43.881142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.881690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:43.884341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 989/1964] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:43 2022] DELETE /identity/v3/projects/9df6a4f7ad504f3fbcd98e362b6b1498 => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:43.884938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:43.887487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.889391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b200-4283-45b6-b930-b968524a560f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.890913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8288b200-4283-45b6-b930-b968524a560f service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.901986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 976/1965] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:43 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 190 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:43.910185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf558-c488-4ac2-9903-b9ed4e6915ff None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.910185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf558-c488-4ac2-9903-b9ed4e6915ff None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.910185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43bf558-c488-4ac2-9903-b9ed4e6915ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.924098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b43bf558-c488-4ac2-9903-b9ed4e6915ff None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:43.925315 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b43bf558-c488-4ac2-9903-b9ed4e6915ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:43.973473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-737b9d26-7b2b-414e-a910-42c550e3e715 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:43.978768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:43.979437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.979631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.979911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:43.980649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:43.983184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:43.995721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 977/1966] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:43.997097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:43.997552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:43.997887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.016442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:44.017764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.026819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 978/1967] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:44.027641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.033901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.046110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1de0439-748a-4605-9b97-200ff0e4c41f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.052443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.053321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.053598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.053907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] PATH_INFO: `/v3/users/37848771c61a46f98f000203a3afe51d` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.055219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=37848771c61a46f98f000203a3afe51d)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.057167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.398353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 990/1968] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:43 2022] POST /identity/v3/projects => generated 391 bytes in 514 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:44.399413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.459541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8a32e56-211b-4ff8-b018-22566a83ffe7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.464224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.464872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.465163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.465439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.466190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:44.466500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.468101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9bcb11-4d73-49a4-9273-b6abe77ccd2e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.479632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 991/1969] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:44.480870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.481179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.481441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.501177 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:44.502548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.513947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 992/1970] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:44.513947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.529759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b102ea28-87c8-42c1-8a1d-6378f5883d71 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.537167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.537167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.537167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.537167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.537941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.538069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.567292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '37848771c61a46f98f000203a3afe51d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:44.574459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '37848771c61a46f98f000203a3afe51d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:44.587777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '37848771c61a46f98f000203a3afe51d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:44.592293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '37848771c61a46f98f000203a3afe51d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:44.620594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 993/1971] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:44 2022] POST /identity/v3/users => generated 296 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:44.621504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.632508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a7db357-37c5-4183-a364-5163b9d42bf3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.637390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.638070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.638457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.638732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.639425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.641333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.684313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '37848771c61a46f98f000203a3afe51d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:44.698610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 979/1972] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:44 2022] DELETE /identity/v3/users/37848771c61a46f98f000203a3afe51d => generated 0 bytes in 671 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:44.699849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.702511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.726799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 994/1973] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:44 2022] POST /identity/v3/projects => generated 367 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:44.727687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.735685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.742343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:44.804972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab3a6fbe-cfc5-4d53-ba0a-ea4a002a03e9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.810506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c89d7d1-e2d0-43cd-a96b-959c6e94a674 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.811000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.811252 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.811692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.812074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.812941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:44.813417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.815804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9061a492-4710-4383-ba7e-ee0e4c43fea1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.829590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.829590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.829590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.829590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.830589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.830589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.830744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 980/1974] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:44.830744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.830961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 995/1975] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:44.831382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.833438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.833740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.834173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.848346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4320e09-8e09-42a8-8e7f-e55fe33c67a0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.853818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.854289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:44.854520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.854806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.855083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.855514 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.855774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.857735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.869330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 981/1976] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:44.869330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.876752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd02f7c8-69e7-42c6-a952-389566701afd None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.881652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.882352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.882639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.882920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.883719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.885706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.953778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 996/1977] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:44 2022] POST /identity/v3/users => generated 284 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:44.953778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.961933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da74b5f1-599c-4070-9027-ca6d46ee176c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:44.966655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:44.971972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:44.971972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:44.971972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:44.971972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:44.971972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:44.981752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 997/1978] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:44.982590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:44.985454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:44.996188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 982/1979] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:44 2022] POST /identity/v3/projects => generated 373 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:44.997295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.049981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e1f2629-593f-4b06-af7f-06ffed7d5c4b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.069838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8c38a7-b29b-433b-996d-45a39c88ee8e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.075015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.075705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.075984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.076256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.077219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.078969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.094010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 983/1980] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:44 2022] GET /identity/v3/roles => generated 1420 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:45.094010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.102223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e966d1-3a1f-486f-831e-774f2c5b3f6a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.108031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.108940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.109227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.109506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] PATH_INFO: `/v3/projects/28525f6fc64540eb897d47c4a2fa73aa/users/f4ed0586fb304145bba1a4b3f781d77b/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.114912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.115577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.115860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.116139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.126106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:45.127416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.129078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.129209 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] RBAC: Authorizing `identity:create_grant(project_id=28525f6fc64540eb897d47c4a2fa73aa, user_id=f4ed0586fb304145bba1a4b3f781d77b, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.132074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.139831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 998/1981] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:45.140670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.151439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd636f2-ff71-41de-8646-3fefb6bdeb42 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.156831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2930efd0-a1ab-4b0b-8588-ab4d9be0d399 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.157236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930efd0-a1ab-4b0b-8588-ab4d9be0d399 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.157533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930efd0-a1ab-4b0b-8588-ab4d9be0d399 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.157839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2930efd0-a1ab-4b0b-8588-ab4d9be0d399 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.158582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930efd0-a1ab-4b0b-8588-ab4d9be0d399 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.160537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2930efd0-a1ab-4b0b-8588-ab4d9be0d399 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.211243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 984/1982] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:45 2022] PUT /identity/v3/projects/28525f6fc64540eb897d47c4a2fa73aa/users/f4ed0586fb304145bba1a4b3f781d77b/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:45.212555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.234695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:45.247059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 999/1983] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:45 2022] POST /identity/v3/users => generated 287 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:45.248067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.248067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.248067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.287000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] MFA Rules not processed for user `f4ed0586fb304145bba1a4b3f781d77b`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:45.288975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:45.300653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b438d60a-dbd0-4fea-8882-4d0c2541c15e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.307450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.312785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.312785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.312785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.312785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.312785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.331356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 985/1984] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:45.332508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.348302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ed40e9-9e8b-428b-8a36-2880ab311111 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.350130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.351151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.351151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.351474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.352303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.354293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.370264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 986/1985] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:45.370264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.393500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b18616e7-3060-4489-ba65-5fd5d80f8ff0 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.405504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.406808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.411495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.411495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] PATH_INFO: `/v3/projects/afc3cfaa8e964ad39694dc071ef0ca23/users/e2ff7c6d8b92491ca77a4b7965ecce93/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.412554 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1000/1986] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:45.416707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.442578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] RBAC: Authorizing `identity:create_grant(project_id=afc3cfaa8e964ad39694dc071ef0ca23, user_id=e2ff7c6d8b92491ca77a4b7965ecce93, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.446252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1220507-38c4-451d-9159-6ec3ac4e4619 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.447683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.455952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.457092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.457092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.457952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.458130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.459881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.484794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1001/1987] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:45 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:45.486810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.518171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9330877e-efd3-431a-8d08-56b3086c08b2 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.523895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2602fa6-c97d-4e75-926f-2218f4f1d239 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.524687 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602fa6-c97d-4e75-926f-2218f4f1d239 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.525164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602fa6-c97d-4e75-926f-2218f4f1d239 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.525627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2602fa6-c97d-4e75-926f-2218f4f1d239 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.526543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2602fa6-c97d-4e75-926f-2218f4f1d239 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.538714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2602fa6-c97d-4e75-926f-2218f4f1d239 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.613682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 987/1988] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:45 2022] PUT /identity/v3/projects/afc3cfaa8e964ad39694dc071ef0ca23/users/e2ff7c6d8b92491ca77a4b7965ecce93/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:45.613682 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.669219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1002/1989] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:45 2022] POST /identity/v3/projects => generated 391 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:45.670675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.670963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.671238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.714568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] MFA Rules not processed for user `e2ff7c6d8b92491ca77a4b7965ecce93`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:45.717595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:45.799634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f293eaef-6fc8-449a-b238-2591c4fe4a60 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.828806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1003/1990] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:45 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:45.829460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:45.860511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:45.890172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.892911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.893499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.893940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] PATH_INFO: `/v3/projects/3aba620cd55241b5ac8d36b1ead0c9db/users/375e9d0bcc0d49e8ba88a2127f4acfd6/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.911493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aba620cd55241b5ac8d36b1ead0c9db, user_id=375e9d0bcc0d49e8ba88a2127f4acfd6, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.915054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.923199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e45273b-2833-4fd0-8005-4645e38375e7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:45.929853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:45.930659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:45.931006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:45.931348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:45.932254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:45.935644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:45.994783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 988/1991] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:45 2022] PUT /identity/v3/projects/3aba620cd55241b5ac8d36b1ead0c9db/users/375e9d0bcc0d49e8ba88a2127f4acfd6/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:45.998203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.033764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1004/1992] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:45 2022] POST /identity/v3/users => generated 302 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:46.034856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.036893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.051595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac49af8f-3b27-40cc-ba7f-e50288c78dfb admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.089044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ca091c-5703-4da3-b9c4-c92b08b16381 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.094891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08096fc7-b554-452f-8f77-b466f06d5349 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.095556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:46.095736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096fc7-b554-452f-8f77-b466f06d5349 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.095887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096fc7-b554-452f-8f77-b466f06d5349 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.096140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08096fc7-b554-452f-8f77-b466f06d5349 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.096845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08096fc7-b554-452f-8f77-b466f06d5349 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.098885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08096fc7-b554-452f-8f77-b466f06d5349 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.124657 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.125565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.125917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.126326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] PATH_INFO: `/v3/projects/e09f5aa47bca47309d0dce9d5864ac37` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.128210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e09f5aa47bca47309d0dce9d5864ac37)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.130336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.227950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 989/1993] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:45 2022] POST /identity/v3/projects => generated 367 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:46.229653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.229943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.230249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.241158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e09f5aa47bca47309d0dce9d5864ac37', 'request_id': 'req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.255195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e09f5aa47bca47309d0dce9d5864ac37', 'request_id': 'req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.261694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] MFA Rules not processed for user `375e9d0bcc0d49e8ba88a2127f4acfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:46.263074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.263995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e09f5aa47bca47309d0dce9d5864ac37', 'request_id': 'req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.328086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 990/1994] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:46 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:46.329052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.352265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] The token cache is being invalidate because project e09f5aa47bca47309d0dce9d5864ac37 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:46.355836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.355836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.355836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1005/1995] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:46 2022] DELETE /identity/v3/projects/e09f5aa47bca47309d0dce9d5864ac37 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:46.355836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.357541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.403232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5d6e0e6-ad77-47fc-b616-5eafdd13c79e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.409220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.410109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.410723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.411008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.412028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.413668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.430286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 991/1996] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:46.430286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.435653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.439900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9605823-ec8a-4408-ba6c-a9b36d0e3ef6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.448828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.450058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.450842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.451126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.451904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.456283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.515454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7019701e-8a72-45b5-8bf3-1064f34f594d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.520966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.521713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.522104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.522456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.524392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.544611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.550901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.561973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 992/1997] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:46 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:46.563073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.565278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:46.566906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.575504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1006/1998] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:46 2022] POST /identity/v3/users => generated 290 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:46.576166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.582917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:46.583356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd9d95e5-3bbe-4a2d-a1a0-312195ac5499 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.588901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.590012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.590433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.591029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] PATH_INFO: `/v3/users/ddce3053869e4957a07320e98cf4f92c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.592630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] RBAC: Authorizing `identity:delete_user(user_id=ddce3053869e4957a07320e98cf4f92c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.595923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.598669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f440a66-1b43-4408-8622-dffbc964ae72 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.620118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.622561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.622873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.624947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] PATH_INFO: `/v3/projects/e66dff9ab8ce406d840b1433e9db179b/users/ef3ae996d0914bdf90281a52aac2012e/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.658995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66dff9ab8ce406d840b1433e9db179b, user_id=ef3ae996d0914bdf90281a52aac2012e, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.662763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.719115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:46.751290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1007/1999] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:46 2022] PUT /identity/v3/projects/e66dff9ab8ce406d840b1433e9db179b/users/ef3ae996d0914bdf90281a52aac2012e/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:46.751290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.813175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ddce3053869e4957a07320e98cf4f92c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.821288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ddce3053869e4957a07320e98cf4f92c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.823945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6dff46c-47a1-42d5-9f22-bbb585d2c0b7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.830195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.832273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.832856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.834593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.834593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.835966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ddce3053869e4957a07320e98cf4f92c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.836860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ddce3053869e4957a07320e98cf4f92c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.837087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.849126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1008/2000] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:46.850405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.860176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-924e894b-f5f5-46a4-ac48-8bd9bfee68d4 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.865401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.866087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.866375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.866951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.867668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.869382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.879645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1009/2001] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:46 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:46.880481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.890776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a69d9d-c0e8-4504-a6af-6c2155cfba33 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:46.895928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:46.896763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:46.897043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:46.897321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] PATH_INFO: `/v3/projects/6ae1f45da758494b820532c750b09bb9/users/f2d4cf870ef14f57a328ee6121b9be1c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:46.907094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ddce3053869e4957a07320e98cf4f92c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:46.915377 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae1f45da758494b820532c750b09bb9, user_id=f2d4cf870ef14f57a328ee6121b9be1c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:46.915477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 993/2002] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:46 2022] DELETE /identity/v3/users/ddce3053869e4957a07320e98cf4f92c => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:46.916458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:46.916569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:46.927077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.006978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8168d5eb-fc0c-41cc-8cc4-9f7db09a66da admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.013194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1010/2003] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:46 2022] PUT /identity/v3/projects/6ae1f45da758494b820532c750b09bb9/users/f2d4cf870ef14f57a328ee6121b9be1c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:47.017744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:47.021262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.109458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-589f86be-d51e-408f-aafd-5b3321fa0840 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.111318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f86be-d51e-408f-aafd-5b3321fa0840 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.112560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f86be-d51e-408f-aafd-5b3321fa0840 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.113054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-589f86be-d51e-408f-aafd-5b3321fa0840 admin admin] PATH_INFO: `/v3/projects/e66dff9ab8ce406d840b1433e9db179b/users/ef3ae996d0914bdf90281a52aac2012e/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.116531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f86be-d51e-408f-aafd-5b3321fa0840 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e66dff9ab8ce406d840b1433e9db179b, user_id=ef3ae996d0914bdf90281a52aac2012e, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.122086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-589f86be-d51e-408f-aafd-5b3321fa0840 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.127762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:47.139725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 994/2004] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:46 2022] PUT /identity/v3/projects/e66dff9ab8ce406d840b1433e9db179b/users/ef3ae996d0914bdf90281a52aac2012e/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:47.151946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.157616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.157616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.204160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d22a9e6-ecf0-400b-98a5-afcb0ebb6f8c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.217741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] MFA Rules not processed for user `ef3ae996d0914bdf90281a52aac2012e`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:47.217741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.271706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:47.382591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.383280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.383571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.383828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.384830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.387070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.396228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 995/2005] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 245 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:47.401606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:47.404883 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.413948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1011/2006] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:47 2022] GET /identity/v3/roles => generated 1420 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:47.415473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:47.432398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f253ae29-5a34-40f1-857e-10a64c242900 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.445762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3c894a-4a69-4fe8-9479-ecd3bc4a1968 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.446712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c894a-4a69-4fe8-9479-ecd3bc4a1968 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.446994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c894a-4a69-4fe8-9479-ecd3bc4a1968 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.447270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3c894a-4a69-4fe8-9479-ecd3bc4a1968 admin admin] PATH_INFO: `/v3/projects/6ae1f45da758494b820532c750b09bb9/users/f2d4cf870ef14f57a328ee6121b9be1c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.452314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c894a-4a69-4fe8-9479-ecd3bc4a1968 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6ae1f45da758494b820532c750b09bb9, user_id=f2d4cf870ef14f57a328ee6121b9be1c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.463224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3c894a-4a69-4fe8-9479-ecd3bc4a1968 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.492052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1012/2007] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:47 2022] PUT /identity/v3/projects/6ae1f45da758494b820532c750b09bb9/users/f2d4cf870ef14f57a328ee6121b9be1c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:47.492635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:47.494436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.494732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.495008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.555775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] MFA Rules not processed for user `f2d4cf870ef14f57a328ee6121b9be1c`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:47.557032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.557439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29bb018b-df4a-4051-abba-86033bc4b487 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.651997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1013/2008] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:47 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:47.652869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.658399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.658399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.658399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.662936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:47.664535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.689973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c049226-5120-4ea3-ba38-c8f5c722608e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.700591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.701848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.702972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.703931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.732549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.734793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.754996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1014/2009] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:47.756158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:47.757735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.777798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.781367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.790524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:47.813706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 996/2010] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 412 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:47.844190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32c6bdc3-193f-4506-b9c7-a1f4b3bd9b97 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.850716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.850716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.851205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.851902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] PATH_INFO: `/v3/projects/7242802e630d4ef8a4c139ac97bf9093` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.853304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7242802e630d4ef8a4c139ac97bf9093)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.855591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.861578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:47.874892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37b57e93-6f1f-4753-a7c3-82dfa691bb85 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:47.884510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:47.884510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:47.884510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:47.884510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:47.884868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:47.957512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:47.959008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:47.968135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 997/2011] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:47 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:48.006906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7242802e630d4ef8a4c139ac97bf9093', 'request_id': 'req-b085172f-6334-4b36-b21b-272436f95693'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.012957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7242802e630d4ef8a4c139ac97bf9093', 'request_id': 'req-b085172f-6334-4b36-b21b-272436f95693'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.022205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:48.022205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7242802e630d4ef8a4c139ac97bf9093', 'request_id': 'req-b085172f-6334-4b36-b21b-272436f95693'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.038770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.047860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87575576-f4cf-4451-ae0b-5bd5761d1d76 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.100547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.101277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.101638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.101989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.104087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.139693 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] The token cache is being invalidate because project 7242802e630d4ef8a4c139ac97bf9093 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:48.142749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.142749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b085172f-6334-4b36-b21b-272436f95693 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.142749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1015/2012] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:47 2022] DELETE /identity/v3/projects/7242802e630d4ef8a4c139ac97bf9093 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:48.147184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946f75-2cad-4f67-90c7-cab89683f58b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.148811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946f75-2cad-4f67-90c7-cab89683f58b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.149195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78946f75-2cad-4f67-90c7-cab89683f58b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.169981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.171925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7e4405-6b0d-4ac3-8488-fe49f624eb36 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.173135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-78946f75-2cad-4f67-90c7-cab89683f58b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:48.175352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-78946f75-2cad-4f67-90c7-cab89683f58b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.182418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 998/2013] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:48.183624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3ccc-cbdb-4de4-b0b8-89a989cfc262 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.188799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3ccc-cbdb-4de4-b0b8-89a989cfc262 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.188799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4c3ccc-cbdb-4de4-b0b8-89a989cfc262 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.188799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 999/2014] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:16:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:16:48.194674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.196122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.198303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.224431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:48.226242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.249858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1016/2015] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:48.257248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.258072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.258072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.276588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:48.277904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.290212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1017/2016] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:48.294054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.305817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b48a96-d1a6-46b3-8e97-eccbd9ac482a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.319112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1000/2017] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:48.326644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.327356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.327654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.327919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.328726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:48.329161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.330951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.334802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.336292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.353908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1018/2018] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:48.357566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.369458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397acd23-aac8-4633-89c8-0908ec9a6c3b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.370951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a2eafc2-d13b-4738-a7a1-c5b20d440625 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.385826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.386055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.386707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.386888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.387000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.387258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.387574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.388264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.389056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.391228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.398463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.400433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.424826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1001/2019] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:48.425871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.427444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.447589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdfdd29-1766-4cfd-b5a8-6d5ce6afd5ba service placement] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.456017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.457690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.458128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.458721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] PATH_INFO: `/v3/users/53d4ddc721bf438d890c7dbae8d2b775` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.460240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] RBAC: Authorizing `identity:delete_user(user_id=53d4ddc721bf438d890c7dbae8d2b775)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.469147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.496313 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1019/2020] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/projects => generated 385 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:48.500607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.571392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd5f8f42-191f-4d64-9511-349a90119306 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.578109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.578109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.578109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.578109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.578459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.580859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.666130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1020/2021] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/users => generated 293 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:48.670015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.674081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '53d4ddc721bf438d890c7dbae8d2b775'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.680112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21556bab-7b99-44cc-85ae-3399bea6b09f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.681842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '53d4ddc721bf438d890c7dbae8d2b775'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.685129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.685784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.690429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.690429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.690429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.690429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.694479 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '53d4ddc721bf438d890c7dbae8d2b775'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.695178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '53d4ddc721bf438d890c7dbae8d2b775'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.699025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1021/2022] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:48.702906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.712798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da42534a-a04d-46c4-a25b-61516964860d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.717460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.718106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.718392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.718671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.719364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.721527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.731689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1022/2023] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:48.735443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:48.745786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e61140-543a-4aec-89f3-0def237e5a75 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:48.756892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87080038-5dfb-4090-b76e-871594c70530 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:48.757947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080038-5dfb-4090-b76e-871594c70530 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.758321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080038-5dfb-4090-b76e-871594c70530 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.758731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87080038-5dfb-4090-b76e-871594c70530 admin admin] PATH_INFO: `/v3/projects/3660237ee8ad49d4890848f06467bdaf/users/2e15650841064fe0a2ac480f15ec4346/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.765047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-56bf79f3-d07c-4d8e-bcb0-579acd0b0d32 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '53d4ddc721bf438d890c7dbae8d2b775'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:48.765202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:48.773491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1002/2024] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:48 2022] DELETE /identity/v3/users/53d4ddc721bf438d890c7dbae8d2b775 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:48.778257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87080038-5dfb-4090-b76e-871594c70530 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3660237ee8ad49d4890848f06467bdaf, user_id=2e15650841064fe0a2ac480f15ec4346, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:48.780902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87080038-5dfb-4090-b76e-871594c70530 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:48.812460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.812754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.813037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.852020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] MFA Rules not processed for user `375e9d0bcc0d49e8ba88a2127f4acfd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:48.853617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:48.885610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1023/2025] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:48 2022] PUT /identity/v3/projects/3660237ee8ad49d4890848f06467bdaf/users/2e15650841064fe0a2ac480f15ec4346/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:48.911425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:48.911425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:48.911425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:48.944693 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] MFA Rules not processed for user `2e15650841064fe0a2ac480f15ec4346`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:48.945324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1003/2026] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:48.963045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.034506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1024/2027] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:48 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:49.039220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.040929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.075604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:49.079585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.081947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.123488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68226aee-8833-4dbe-918f-5f03afdf4b07 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.178220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39729dbf-baf9-4e4e-ac50-66908f357d12 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.184028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.184945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.185224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.185541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] PATH_INFO: `/v3/projects/b2c0c79cfceb46319418afcbd9c01af4` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.187005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2c0c79cfceb46319418afcbd9c01af4)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.188860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.193328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.194005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.194466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.194750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.195472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.197387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.289770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1004/2028] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/projects => generated 385 bytes in 251 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:49.290690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.299127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2c0c79cfceb46319418afcbd9c01af4', 'request_id': 'req-396d002e-f08b-4455-8fd1-ac7fc98279e1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:49.305446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2c0c79cfceb46319418afcbd9c01af4', 'request_id': 'req-396d002e-f08b-4455-8fd1-ac7fc98279e1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:49.312353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2c0c79cfceb46319418afcbd9c01af4', 'request_id': 'req-396d002e-f08b-4455-8fd1-ac7fc98279e1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:49.356033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7248701-0044-4094-9da6-4a62196f8c0d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.361476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.362182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.362465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.362740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.363446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.365368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.401042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] The token cache is being invalidate because project b2c0c79cfceb46319418afcbd9c01af4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:49.401335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:49.401960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-396d002e-f08b-4455-8fd1-ac7fc98279e1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:49.403700 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1025/2029] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:49 2022] DELETE /identity/v3/projects/b2c0c79cfceb46319418afcbd9c01af4 => generated 0 bytes in 325 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:49.408604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b69f-d5b8-4590-92de-9a3b8145c51e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.408891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b69f-d5b8-4590-92de-9a3b8145c51e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.409199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5b69f-d5b8-4590-92de-9a3b8145c51e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.428025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e8b5b69f-d5b8-4590-92de-9a3b8145c51e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:49.429213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e8b5b69f-d5b8-4590-92de-9a3b8145c51e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.439629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1026/2030] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:49.446518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.446807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.447087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.465523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1005/2031] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/users => generated 299 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:49.468428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:49.468428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.469466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.471096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.474272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1027/2032] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:49.477934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.484016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:49.489395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8e305bd-e4ed-4251-9d48-c105d3b10e4c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.491336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94001758-97cf-4476-9172-7dee18d8ef89 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.491953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.493765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.494223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.494655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.495563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.496546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.498069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.498433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.498785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.498900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.499897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:49.500262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.502614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.518076 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1028/2033] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:49.520692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1006/2034] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:49.525288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.525444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.537047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5560cb67-4118-449f-8acf-13d0bbaf3d41 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.539589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf4d57ed-193d-4d17-a309-bf2cd928e00c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.543597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.544066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.544628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.545104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.545446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.546095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.546372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.546654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.546951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] PATH_INFO: `/v3/projects/c5e8b2f67aeb4b9f896970d32fc1c224/users/1bd164c6af86422bac81213511cdb7c4/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.549903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.564954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e8b2f67aeb4b9f896970d32fc1c224, user_id=1bd164c6af86422bac81213511cdb7c4, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.567377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.650379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1029/2035] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/projects => generated 389 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:49.655464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.674337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:49.683598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1007/2036] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:49 2022] PUT /identity/v3/projects/c5e8b2f67aeb4b9f896970d32fc1c224/users/1bd164c6af86422bac81213511cdb7c4/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:49.687585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.735435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca3362a3-ded0-415b-aba3-6beabadafc5c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.763697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43a999e-841b-47ec-a6bf-a247359f43e7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.768532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.769208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.769496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.769779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.770586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.772211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.782530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1008/2037] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:49.789737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.800214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5cbc1f2-ce89-4c76-9cd1-7b79a50b61ce admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.803251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.804093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.804215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.804495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.804917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3ba634-6f6f-41af-95fe-6d74278532d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.805176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.805792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ba634-6f6f-41af-95fe-6d74278532d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.806118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ba634-6f6f-41af-95fe-6d74278532d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.806405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3ba634-6f6f-41af-95fe-6d74278532d0 admin admin] PATH_INFO: `/v3/projects/c5e8b2f67aeb4b9f896970d32fc1c224/users/1bd164c6af86422bac81213511cdb7c4/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.807120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.808456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ba634-6f6f-41af-95fe-6d74278532d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5e8b2f67aeb4b9f896970d32fc1c224, user_id=1bd164c6af86422bac81213511cdb7c4, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.811170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3ba634-6f6f-41af-95fe-6d74278532d0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.821527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1009/2038] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:49 2022] PUT /identity/v3/projects/c5e8b2f67aeb4b9f896970d32fc1c224/users/1bd164c6af86422bac81213511cdb7c4/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:49.832511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.832808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.833087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.862569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] MFA Rules not processed for user `1bd164c6af86422bac81213511cdb7c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:49.863814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.901887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1030/2039] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/users => generated 295 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:16:49.903936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.915415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4917aa0a-ec5e-4b35-8984-44213bd9ae5a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:49.944323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1010/2040] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:49 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:49.955745 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:49.957420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:49.976419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:49.977123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:49.977407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:49.977696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:49.978510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:49.980125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:49.990453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1031/2041] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:49.994579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:50.004343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b0407e-3f97-498f-9fde-940c41d16c66 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:50.009734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a0178-730a-4299-be9a-690611763faf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:50.010454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a0178-730a-4299-be9a-690611763faf admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.010742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a0178-730a-4299-be9a-690611763faf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.011016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-099a0178-730a-4299-be9a-690611763faf admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.011742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a0178-730a-4299-be9a-690611763faf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:50.013339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-099a0178-730a-4299-be9a-690611763faf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:50.022787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ab1baa-f41f-48e0-a295-848b224e03f1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:50.026944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1032/2042] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:50.027074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:50.027182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.027454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.031997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.032096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a0178-730a-4299-be9a-690611763faf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:50.038311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:50.038478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-099a0178-730a-4299-be9a-690611763faf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:50.039750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:50.042934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99643596-2c2f-442e-8ddf-7ec1f00cb638 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:50.043805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643596-2c2f-442e-8ddf-7ec1f00cb638 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.044086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643596-2c2f-442e-8ddf-7ec1f00cb638 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.044360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99643596-2c2f-442e-8ddf-7ec1f00cb638 admin admin] PATH_INFO: `/v3/projects/32b0340ed2c94562826c27f8c34bab81/users/5aa93da151774e5eaa092cdc5d445dba/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.049605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1011/2043] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:49 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:50.061879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643596-2c2f-442e-8ddf-7ec1f00cb638 admin admin] RBAC: Authorizing `identity:create_grant(project_id=32b0340ed2c94562826c27f8c34bab81, user_id=5aa93da151774e5eaa092cdc5d445dba, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:50.066760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99643596-2c2f-442e-8ddf-7ec1f00cb638 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:50.163102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:50.176329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c6f2401-8aff-46d1-888a-b8cacf9acc18 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:50.181510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1033/2044] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:50 2022] PUT /identity/v3/projects/32b0340ed2c94562826c27f8c34bab81/users/5aa93da151774e5eaa092cdc5d445dba/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:50.185628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.185920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.186242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.205860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:50.207567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:50.244183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:50.245128 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.245416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.245753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] PATH_INFO: `/v3/users/2e15650841064fe0a2ac480f15ec4346` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.247698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e15650841064fe0a2ac480f15ec4346)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:50.249787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:50.290414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1034/2045] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:50.299342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:50.302145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:50.356560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:50.361908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1889787f-2ec6-48e2-a1b9-c76c3684ce4b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:50.365952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dfb4579-e70b-4d39-938f-1791cb027c19 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:50.367204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4579-e70b-4d39-938f-1791cb027c19 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.367483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4579-e70b-4d39-938f-1791cb027c19 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.367752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dfb4579-e70b-4d39-938f-1791cb027c19 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.378001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb4579-e70b-4d39-938f-1791cb027c19 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:50.379569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dfb4579-e70b-4d39-938f-1791cb027c19 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:50.401732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1035/2046] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:50.533951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e15650841064fe0a2ac480f15ec4346'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:50.541636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e15650841064fe0a2ac480f15ec4346'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:50.555837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e15650841064fe0a2ac480f15ec4346'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:50.556583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e15650841064fe0a2ac480f15ec4346'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:50.615416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e15650841064fe0a2ac480f15ec4346'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:50.615823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:50.623833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1012/2047] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:50 2022] DELETE /identity/v3/users/2e15650841064fe0a2ac480f15ec4346 => generated 0 bytes in 461 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:50.628720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.629012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.629357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.656824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:50.656824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:50.740870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1036/2048] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:50.754047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:50.756156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:50.873981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1df9207d-9dda-4735-afda-b4fdbe12b1bf admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:50.879451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:50.880116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:50.880412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:50.880689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:50.891083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:50.892680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:50.902971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1013/2049] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:51.307172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:51.450967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:51.452395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:51.464900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09632a9c-6cd2-479c-9d2c-b760721c4d80 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:51.469597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:51.471042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:51.471328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:51.471608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] PATH_INFO: `/v3/projects/3660237ee8ad49d4890848f06467bdaf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:51.472812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] RBAC: Authorizing `identity:delete_project(project_id=3660237ee8ad49d4890848f06467bdaf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:51.474788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:51.608230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3660237ee8ad49d4890848f06467bdaf', 'request_id': 'req-dcbd7952-ac34-464e-9692-9faa1c68a9eb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:51.613644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3660237ee8ad49d4890848f06467bdaf', 'request_id': 'req-dcbd7952-ac34-464e-9692-9faa1c68a9eb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:51.620101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3660237ee8ad49d4890848f06467bdaf', 'request_id': 'req-dcbd7952-ac34-464e-9692-9faa1c68a9eb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:51.712201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] The token cache is being invalidate because project 3660237ee8ad49d4890848f06467bdaf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:51.712487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:51.713121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:51.714714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1037/2050] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:51 2022] DELETE /identity/v3/projects/3660237ee8ad49d4890848f06467bdaf => generated 0 bytes in 264 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:51.718776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:51.728852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-598d38ef-c951-4d97-ab5c-8a1ea2a0c65d service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:51.785707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:51.786606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:51.786890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:51.787170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] PATH_INFO: `/v3/users/1bd164c6af86422bac81213511cdb7c4` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:51.788370 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] RBAC: Authorizing `identity:delete_user(user_id=1bd164c6af86422bac81213511cdb7c4)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:51.790366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:51.994198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:52.012307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1bd164c6af86422bac81213511cdb7c4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:52.026306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1bd164c6af86422bac81213511cdb7c4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:52.058130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1bd164c6af86422bac81213511cdb7c4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:52.059558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1bd164c6af86422bac81213511cdb7c4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:52.181430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1bd164c6af86422bac81213511cdb7c4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:52.197074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1014/2051] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:51 2022] DELETE /identity/v3/users/1bd164c6af86422bac81213511cdb7c4 => generated 0 bytes in 479 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:53.040707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:53.044320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:53.069982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbd7952-ac34-464e-9692-9faa1c68a9eb admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:53.194133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:53.195424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.195961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.196429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] PATH_INFO: `/v3/projects/c5e8b2f67aeb4b9f896970d32fc1c224` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.197970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5e8b2f67aeb4b9f896970d32fc1c224)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:53.200193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:53.337433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5e8b2f67aeb4b9f896970d32fc1c224', 'request_id': 'req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.344681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5e8b2f67aeb4b9f896970d32fc1c224', 'request_id': 'req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.351532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5e8b2f67aeb4b9f896970d32fc1c224', 'request_id': 'req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.360650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:53.362219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:53.375586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f38cc0a3-c2df-43b7-8c26-a834032fe218 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:53.423108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] The token cache is being invalidate because project c5e8b2f67aeb4b9f896970d32fc1c224 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:53.423508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.424318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9a4286d3-69d8-4811-8c93-1d3455b6f8fe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.426368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1038/2052] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:53 2022] DELETE /identity/v3/projects/c5e8b2f67aeb4b9f896970d32fc1c224 => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:53.431168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d326610-5790-466d-b3b8-25e401860e5a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.431537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d326610-5790-466d-b3b8-25e401860e5a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.431889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d326610-5790-466d-b3b8-25e401860e5a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.462592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:53.463722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.464110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.464499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] PATH_INFO: `/v3/users/f4ed0586fb304145bba1a4b3f781d77b` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.464627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-0d326610-5790-466d-b3b8-25e401860e5a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:53.465906 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0d326610-5790-466d-b3b8-25e401860e5a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:53.466307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f4ed0586fb304145bba1a4b3f781d77b)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:53.469434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:53.477597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1039/2053] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:53.492615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.492914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.493197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.497984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:53.556647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:53.557754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:53.582476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:53.582922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1040/2054] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:53.586813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:53.598216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d779c7fa-0919-4a74-a682-a36c7a0448f0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:53.603062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:53.603734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.604024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.604304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.605103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:53.605600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:53.607563 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:53.624836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1041/2055] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:16:53.629517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:53.643281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a93b076-79eb-43b2-82c1-14abb5fb9fc9 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:53.649761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:53.651418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.651931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.652408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.653321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:53.656571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:53.703482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f4ed0586fb304145bba1a4b3f781d77b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.713707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f4ed0586fb304145bba1a4b3f781d77b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.728217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f4ed0586fb304145bba1a4b3f781d77b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.729111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f4ed0586fb304145bba1a4b3f781d77b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.837481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1042/2056] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:53 2022] POST /identity/v3/projects => generated 399 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:53.838849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:53.849793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-faafb0b3-f863-48d4-a3fb-003d85ecc542 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f4ed0586fb304145bba1a4b3f781d77b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:53.865260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1015/2057] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:53 2022] DELETE /identity/v3/users/f4ed0586fb304145bba1a4b3f781d77b => generated 0 bytes in 505 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:53.871741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:53.872046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:53.872734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:53.904730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:53.907775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:54.010738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa010ed3-6220-43ff-adfb-c8b6a2dd1f1a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:54.016387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1016/2058] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:54.026051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:54.026905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.027738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.028127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.028975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:54.031083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:54.043452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:54.045616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:54.121641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4e7efe-d8dc-41b2-bb74-85a4ae80d46e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:54.126053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:54.126765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.127051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.127339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.140818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:54.142401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:54.153587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1017/2059] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:54.247425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1043/2060] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:53 2022] POST /identity/v3/users => generated 300 bytes in 409 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:54.252007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:54.254517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:54.281105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7895cd-e804-4928-8824-a1cf2610b9d2 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:54.293563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:54.294260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.294543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.294823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.295558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:54.298942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:54.323583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1018/2061] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 72 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:54.328808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:54.342815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedc4c36-c01c-4f50-9129-80e472aa473d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:54.351699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cb1cf1-bc2e-49d5-a8bd-0d3082f90510 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:54.354017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1cf1-bc2e-49d5-a8bd-0d3082f90510 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.354281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1cf1-bc2e-49d5-a8bd-0d3082f90510 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.369363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cb1cf1-bc2e-49d5-a8bd-0d3082f90510 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.369363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb1cf1-bc2e-49d5-a8bd-0d3082f90510 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:54.369363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cb1cf1-bc2e-49d5-a8bd-0d3082f90510 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:54.386790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1044/2062] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:54 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:54.388908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:54.405340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb85db83-f4ad-4bd9-8f44-fd6da5af9fad admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:54.412281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:54.413428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.413776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.414203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] PATH_INFO: `/v3/projects/319f0c0588a74e26bc21b26aba099562/users/2f16aad535d24fb9ae80be3997b40896/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.435918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] RBAC: Authorizing `identity:create_grant(project_id=319f0c0588a74e26bc21b26aba099562, user_id=2f16aad535d24fb9ae80be3997b40896, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:54.439019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:54.509782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1019/2063] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:54 2022] PUT /identity/v3/projects/319f0c0588a74e26bc21b26aba099562/users/2f16aad535d24fb9ae80be3997b40896/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 112 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:54.512093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51254ebe-f670-47e2-806c-426521263733 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.512536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51254ebe-f670-47e2-806c-426521263733 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.513362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51254ebe-f670-47e2-806c-426521263733 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.547453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:54.568834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-51254ebe-f670-47e2-806c-426521263733 None None] MFA Rules not processed for user `2f16aad535d24fb9ae80be3997b40896`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:54.574141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-51254ebe-f670-47e2-806c-426521263733 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:54.710762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1045/2064] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:54 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:54.714621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:54.855159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db636e69-f861-4a8a-b1b4-59699276ad3a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:54.864461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:54.865545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:54.866075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:54.867296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:54.868078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:54.873781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.047854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1020/2065] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:54 2022] POST /identity/v3/projects => generated 401 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:55.049406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51254ebe-f670-47e2-806c-426521263733 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.062217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51254ebe-f670-47e2-806c-426521263733 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.134913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.135609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.136040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.136323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.137031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.139124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.207421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.210671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:55.238438 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296c8219-3080-45ec-9624-876f0a97616b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.252677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.253722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.259478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.267333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1046/2066] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:55 2022] POST /identity/v3/users => generated 307 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:55.267826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] PATH_INFO: `/v3/projects/28525f6fc64540eb897d47c4a2fa73aa` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.267920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.273287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] RBAC: Authorizing `identity:delete_project(project_id=28525f6fc64540eb897d47c4a2fa73aa)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.277679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.281720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e446dfb-f63a-4e7d-83a6-e775561e9921 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.299214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.300154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.300583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.301120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.301775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.303436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.328565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1047/2067] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:16:55.332374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.342752 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691ee937-eb0c-488a-b3cd-cd532c21dc08 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.360500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.360500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.360500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.360500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] PATH_INFO: `/v3/projects/3aa07cfd75b141c29da2b5fa10fdbafa/users/fe1f797fd64a44c185b5a5ef52e7daba/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.376296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa07cfd75b141c29da2b5fa10fdbafa, user_id=fe1f797fd64a44c185b5a5ef52e7daba, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.380836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.503212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1048/2068] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:55 2022] PUT /identity/v3/projects/3aa07cfd75b141c29da2b5fa10fdbafa/users/fe1f797fd64a44c185b5a5ef52e7daba/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:55.504662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.515405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '28525f6fc64540eb897d47c4a2fa73aa', 'request_id': 'req-df98ab92-58ea-42c3-bf9b-5f7077eb1758'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:55.522858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '28525f6fc64540eb897d47c4a2fa73aa', 'request_id': 'req-df98ab92-58ea-42c3-bf9b-5f7077eb1758'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:55.532184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '28525f6fc64540eb897d47c4a2fa73aa', 'request_id': 'req-df98ab92-58ea-42c3-bf9b-5f7077eb1758'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:55.631002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] The token cache is being invalidate because project 28525f6fc64540eb897d47c4a2fa73aa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:55.631746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:55.632774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:55.632892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c17da1a-0691-4b1d-ae7f-44558f8b0a77 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.637066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1021/2069] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:55 2022] DELETE /identity/v3/projects/28525f6fc64540eb897d47c4a2fa73aa => generated 0 bytes in 430 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:55.640808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.642772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:55.748692 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.749474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.752987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.753388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.754985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.760817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.779455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df98ab92-58ea-42c3-bf9b-5f7077eb1758 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.787052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1049/2070] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:55 2022] GET /identity/v3/roles => generated 1420 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:55.787052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:55.787712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.788815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.789023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:55.789493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.789846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] PATH_INFO: `/v3/users/ef3ae996d0914bdf90281a52aac2012e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.791447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] RBAC: Authorizing `identity:delete_user(user_id=ef3ae996d0914bdf90281a52aac2012e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.793651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:55.814970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9917b73f-5cfb-4fff-874e-cc845b90f78f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:55.821372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:55.822290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:55.822571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:55.822847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] PATH_INFO: `/v3/users/e2ff7c6d8b92491ca77a4b7965ecce93` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:55.824072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e2ff7c6d8b92491ca77a4b7965ecce93)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:55.826450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:56.029337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ef3ae996d0914bdf90281a52aac2012e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.040338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ef3ae996d0914bdf90281a52aac2012e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.059528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ef3ae996d0914bdf90281a52aac2012e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.064390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ef3ae996d0914bdf90281a52aac2012e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.065159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:56.084848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e2ff7c6d8b92491ca77a4b7965ecce93'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.100849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e2ff7c6d8b92491ca77a4b7965ecce93'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.110332 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e2ff7c6d8b92491ca77a4b7965ecce93'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.111089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e2ff7c6d8b92491ca77a4b7965ecce93'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.196296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ef3ae996d0914bdf90281a52aac2012e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.204046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1022/2071] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:55 2022] DELETE /identity/v3/users/ef3ae996d0914bdf90281a52aac2012e => generated 0 bytes in 561 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:56.204046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:56.206770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:56.217857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=5,keystone:SELECT=94,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:56.264618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673c6097-f09c-4ec1-9ae4-c8f89d12fec9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e2ff7c6d8b92491ca77a4b7965ecce93'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:56.272161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1050/2072] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:55 2022] DELETE /identity/v3/users/e2ff7c6d8b92491ca77a4b7965ecce93 => generated 0 bytes in 487 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:56.277020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:56.277582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:56.277582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:56.304309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:56.305991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:56.344749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135bffe4-2c5a-41ef-b2c5-a97a15cd9ddd admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:56.408284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1051/2073] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:16:56.422568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:56.425290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:56.451028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a85f2fb-588c-4c19-8db4-c171454705a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:56.451429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f2fb-588c-4c19-8db4-c171454705a0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:56.452053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f2fb-588c-4c19-8db4-c171454705a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:56.452867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85f2fb-588c-4c19-8db4-c171454705a0 admin admin] PATH_INFO: `/v3/projects/3aa07cfd75b141c29da2b5fa10fdbafa/users/fe1f797fd64a44c185b5a5ef52e7daba/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:56.464691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f2fb-588c-4c19-8db4-c171454705a0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3aa07cfd75b141c29da2b5fa10fdbafa, user_id=fe1f797fd64a44c185b5a5ef52e7daba, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:56.469187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a85f2fb-588c-4c19-8db4-c171454705a0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:56.481046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1023/2074] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:56 2022] PUT /identity/v3/projects/3aa07cfd75b141c29da2b5fa10fdbafa/users/fe1f797fd64a44c185b5a5ef52e7daba/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:56.491811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:56.492052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e602de1d-7c83-420b-9f6b-4bb030c86340 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:56.492156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:56.492366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:56.522708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] MFA Rules not processed for user `fe1f797fd64a44c185b5a5ef52e7daba`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:56.524664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:56.570462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:56.571229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:56.571651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:56.572001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:56.610440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1024/2075] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:56 2022] POST /identity/v3/auth/tokens => generated 3335 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:56.624763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:56.627654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:56.673948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:56.673948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:56.685218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1052/2076] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 263 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:56.746693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbf6e91-0088-4949-87a0-c24949d90169 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:56.752794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:56.753473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:56.753760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:56.754069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:56.769458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:56.769657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:56.783094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1025/2077] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:56 2022] GET /identity/v3/auth/tokens => generated 3335 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:16:57.013896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:57.023961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a78022b-a78d-4cb0-9ea8-1cb4044f6eb4 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:57.028266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:57.029398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.029714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.029967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.031852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:57.106197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:57.107646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a434d3d-308f-4b70-a6d2-6f31a617f1cb service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:57.119544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1053/2078] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:57 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:57.177270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:57.177666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:57.193845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aec13d0e-93f6-42f3-a880-8495fc22cc96 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:57.207674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:57.208966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.209318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.209695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] PATH_INFO: `/v3/projects/e66dff9ab8ce406d840b1433e9db179b` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.212909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] RBAC: Authorizing `identity:delete_project(project_id=e66dff9ab8ce406d840b1433e9db179b)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:57.215117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:57.401260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e66dff9ab8ce406d840b1433e9db179b', 'request_id': 'req-a17a8608-607f-43fd-927d-2c3d2e8e307c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.410981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e66dff9ab8ce406d840b1433e9db179b', 'request_id': 'req-a17a8608-607f-43fd-927d-2c3d2e8e307c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.423059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e66dff9ab8ce406d840b1433e9db179b', 'request_id': 'req-a17a8608-607f-43fd-927d-2c3d2e8e307c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.562236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] The token cache is being invalidate because project e66dff9ab8ce406d840b1433e9db179b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:57.562777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.563284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.564927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1026/2079] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:57 2022] DELETE /identity/v3/projects/e66dff9ab8ce406d840b1433e9db179b => generated 0 bytes in 390 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:57.575841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9bc0c-9ad8-41fa-9825-bf40cbb1e774 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.576411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9bc0c-9ad8-41fa-9825-bf40cbb1e774 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.576720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f9bc0c-9ad8-41fa-9825-bf40cbb1e774 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.599254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a6f9bc0c-9ad8-41fa-9825-bf40cbb1e774 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:57.604435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a6f9bc0c-9ad8-41fa-9825-bf40cbb1e774 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:57.604698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:57.604698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:57.713522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1054/2080] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:57.723545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.723841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.724119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.736739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17a8608-607f-43fd-927d-2c3d2e8e307c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:57.746060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:57.747606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.747894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.748807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] PATH_INFO: `/v3/projects/afc3cfaa8e964ad39694dc071ef0ca23` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.749996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] RBAC: Authorizing `identity:delete_project(project_id=afc3cfaa8e964ad39694dc071ef0ca23)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:57.755759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:57.759200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:57.762729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:57.777032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1055/2081] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:57.778172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:57.790474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e61bee5-6496-4158-8969-79a2563c7583 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:57.796973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:57.797655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.800024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.800024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.800024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:57.810053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:57.813328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:57.815966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:57.845846 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1056/2082] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:57.850057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:57.878305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6024595-0249-4187-aea2-0475b4fd0047 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:57.883543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:57.884286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:57.884496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:57.884775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:57.885485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:57.887704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:57.913567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'afc3cfaa8e964ad39694dc071ef0ca23', 'request_id': 'req-8b1228de-9c74-442f-b7ae-0321591aba72'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.920373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'afc3cfaa8e964ad39694dc071ef0ca23', 'request_id': 'req-8b1228de-9c74-442f-b7ae-0321591aba72'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:57.933155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:57.934424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'afc3cfaa8e964ad39694dc071ef0ca23', 'request_id': 'req-8b1228de-9c74-442f-b7ae-0321591aba72'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.015756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1057/2083] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:57 2022] POST /identity/v3/projects => generated 367 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:58.020538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.033531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] The token cache is being invalidate because project afc3cfaa8e964ad39694dc071ef0ca23 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:58.034002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.034989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.039876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1027/2084] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:57 2022] DELETE /identity/v3/projects/afc3cfaa8e964ad39694dc071ef0ca23 => generated 0 bytes in 437 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:58.040803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.044146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:58.113881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ea895a-cf92-4e33-bd80-7661fe28b975 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:58.129471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df404b44-2d23-48f7-88bd-e5aae25d7fba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:58.130543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404b44-2d23-48f7-88bd-e5aae25d7fba admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.131649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404b44-2d23-48f7-88bd-e5aae25d7fba admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.132079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df404b44-2d23-48f7-88bd-e5aae25d7fba admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.132795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404b44-2d23-48f7-88bd-e5aae25d7fba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:58.134944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df404b44-2d23-48f7-88bd-e5aae25d7fba admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:58.150496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b1228de-9c74-442f-b7ae-0321591aba72 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:58.155569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:58.156513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.156798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.157074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] PATH_INFO: `/v3/users/f2d4cf870ef14f57a328ee6121b9be1c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.158949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f2d4cf870ef14f57a328ee6121b9be1c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:58.160892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:58.235088 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1058/2085] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:58 2022] POST /identity/v3/users => generated 284 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:58.236473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.236927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.237216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.268759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] MFA Rules not processed for user `5aa93da151774e5eaa092cdc5d445dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:58.270123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:58.333524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1059/2086] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:58.340604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.340604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:58.352662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a727a3ee-4482-4334-9f1a-99f1481f6eda None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:58.358839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:58.359541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.359825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.360108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.360876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:58.362545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:58.373460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1060/2087] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:58.374543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.376840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:58.406046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f2d4cf870ef14f57a328ee6121b9be1c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.415359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f2d4cf870ef14f57a328ee6121b9be1c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.440808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f2d4cf870ef14f57a328ee6121b9be1c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.441631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f2d4cf870ef14f57a328ee6121b9be1c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.457256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d65358-3ca0-430e-af6a-b5de6990a668 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:58.463621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:58.464282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.464628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.464983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.473825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:58.475456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:58.486307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1061/2088] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:58 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:58.487283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.499018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd55ca83-f9f0-4eb9-b14b-52a506fc0301 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:58.505090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:58.506200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.506200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.506392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.507223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:58.508913 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:58.520963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1062/2089] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:58 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:16:58.526463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5edeb849-25e2-4e81-b904-22d7af46044d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f2d4cf870ef14f57a328ee6121b9be1c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:58.526588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.526884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:58.531066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1028/2090] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:16:58 2022] DELETE /identity/v3/users/f2d4cf870ef14f57a328ee6121b9be1c => generated 0 bytes in 488 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:58.552023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f94f3d1f-1547-45d5-b9f2-0982508953a8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:58.617558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:58.619604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.619892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.620194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] PATH_INFO: `/v3/projects/77779ef42df74c4d801a81e7209769d2/users/7d3b51bf0b21434b9d951cf60bbbd11c/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.636647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] RBAC: Authorizing `identity:create_grant(project_id=77779ef42df74c4d801a81e7209769d2, user_id=7d3b51bf0b21434b9d951cf60bbbd11c, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:58.639392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:58.713539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1063/2091] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:16:58 2022] PUT /identity/v3/projects/77779ef42df74c4d801a81e7209769d2/users/7d3b51bf0b21434b9d951cf60bbbd11c/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 189 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:16:58.728083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:58.729387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:58.729699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:58.762262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] MFA Rules not processed for user `7d3b51bf0b21434b9d951cf60bbbd11c`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:58.763592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:58.898075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1029/2092] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:58 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:58.907767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:58.909803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:59.006708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea00374d-7547-4f04-a303-09d6124d434d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:59.010923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8449ccaa-9884-4377-ba2e-59564e3f0ce3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:59.011629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449ccaa-9884-4377-ba2e-59564e3f0ce3 service glance] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.011918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449ccaa-9884-4377-ba2e-59564e3f0ce3 service glance] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.012200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8449ccaa-9884-4377-ba2e-59564e3f0ce3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.022401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449ccaa-9884-4377-ba2e-59564e3f0ce3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:59.023857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8449ccaa-9884-4377-ba2e-59564e3f0ce3 service glance] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:59.033236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1064/2093] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:16:58 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:16:59.096473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:59.096473 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:59.183852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c702945b-1895-4943-9ebd-a8be2d8c1f98 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:59.190398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:59.193563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.193563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.193563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] PATH_INFO: `/v3/projects/6ae1f45da758494b820532c750b09bb9` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.193563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6ae1f45da758494b820532c750b09bb9)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:59.195117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:59.301600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:59.323170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6ae1f45da758494b820532c750b09bb9', 'request_id': 'req-6e77f23d-eb33-4364-b767-74be6aeb43a2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:59.329688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6ae1f45da758494b820532c750b09bb9', 'request_id': 'req-6e77f23d-eb33-4364-b767-74be6aeb43a2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:59.337814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6ae1f45da758494b820532c750b09bb9', 'request_id': 'req-6e77f23d-eb33-4364-b767-74be6aeb43a2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:59.416043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] The token cache is being invalidate because project 6ae1f45da758494b820532c750b09bb9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:16:59.416454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:59.418062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6e77f23d-eb33-4364-b767-74be6aeb43a2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:16:59.419785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1030/2094] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:16:59 2022] DELETE /identity/v3/projects/6ae1f45da758494b820532c750b09bb9 => generated 0 bytes in 326 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:16:59.425819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.426577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.427164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.448613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:59.449832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:59.519450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1065/2095] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:59.520693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.520989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.521272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.547959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:16:59.549963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:16:59.559459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1031/2096] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:16:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:16:59.564453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:59.576171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d419f2bf-059a-4e5f-8d85-27d5c269bce7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:59.585279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:59.585279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.585279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.585279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.585599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:16:59.585599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:59.586263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:59.608689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1066/2097] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:16:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:16:59.608889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:59.619096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c051875-906a-40f7-8c47-ffbb3f19ada1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:59.623906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:59.624566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.624855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.625136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.625841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:59.627892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:59.734186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1032/2098] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:16:59 2022] POST /identity/v3/projects => generated 381 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:16:59.738740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:59.751999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b98a98-cc47-4c64-80ab-00d27a81badf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:59.813840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:59.818911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.818911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.818911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.818911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:59.818911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:59.838760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:16:59.949477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:16:59.949724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1067/2099] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:16:59 2022] POST /identity/v3/users => generated 291 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:16:59.970875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6a69ab-9eae-4eb8-9bc4-de9b8610468d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:16:59.978942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:16:59.980523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:16:59.980937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:16:59.981310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:16:59.982297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:16:59.984487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:16:59.997806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1033/2100] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:16:59 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:00.002287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:00.024141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8705dddb-c2d2-4b75-b915-75e75c95bc65 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:00.040723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd3dfc1-552f-459c-845c-55dcf54ec27e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:00.041556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3dfc1-552f-459c-845c-55dcf54ec27e admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:00.041841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3dfc1-552f-459c-845c-55dcf54ec27e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:00.042254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd3dfc1-552f-459c-845c-55dcf54ec27e admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:00.043071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3dfc1-552f-459c-845c-55dcf54ec27e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:00.047513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dd3dfc1-552f-459c-845c-55dcf54ec27e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:00.060573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1068/2101] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:00.066345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:00.086825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ec0942-cef1-4071-89b9-8990140dc220 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:00.093271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:00.094568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:00.095598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:00.096109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] PATH_INFO: `/v3/projects/c73fa07723ae421181ad8b0755150e78/users/12dbc72b04034137997a310e0e561df1/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:00.122863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c73fa07723ae421181ad8b0755150e78, user_id=12dbc72b04034137997a310e0e561df1, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:00.125752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:00.193757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1034/2102] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:00 2022] PUT /identity/v3/projects/c73fa07723ae421181ad8b0755150e78/users/12dbc72b04034137997a310e0e561df1/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:00.207105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:00.207735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:00.208229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:00.238872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] MFA Rules not processed for user `12dbc72b04034137997a310e0e561df1`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:00.240483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:00.349261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1069/2103] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:00 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:00.353996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:00.521802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f770c3b4-8173-4cb9-aaa9-909bc7baa9f9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:00.537336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:00.538272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:00.538701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:00.539481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:00.545481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:00.547156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:00.653691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1035/2104] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:00 2022] POST /identity/v3/projects => generated 381 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:17:00.654907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:00.672140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=13,keystone:SELECT=85,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:00.685322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f90c52-0c0f-403d-b503-0294ebaf28f5 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:00.796240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:00.796985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:00.797721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:00.797721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:00.799240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:00.803586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:00.952779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1070/2105] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:00 2022] POST /identity/v3/users => generated 297 bytes in 298 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:00.956947 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:00.972282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8032367d-2608-49a8-9202-c2881aff5b86 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:00.987009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:00.987804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:00.988171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:00.988494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:00.989327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:01.000293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:01.022934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1036/2106] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:00 2022] GET /identity/v3/roles => generated 1420 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:01.027970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:01.106246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270e15aa-728e-4d16-b1c8-c4882be3df56 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:01.132539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:01.133608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:01.133979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:01.134195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] PATH_INFO: `/v3/projects/0eae3161931b4f9cbdbde19e611b7deb/users/e70190e9c845452e9dbeed8f06333724/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:01.203775 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eae3161931b4f9cbdbde19e611b7deb, user_id=e70190e9c845452e9dbeed8f06333724, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:01.225924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:01.317884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1071/2107] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:01 2022] PUT /identity/v3/projects/0eae3161931b4f9cbdbde19e611b7deb/users/e70190e9c845452e9dbeed8f06333724/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:01.323222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:01.335384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d708056-827e-4dcd-a952-d9ed4a91bd50 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:01.445101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70535b78-180b-4bb5-b9e8-14c8794da5fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:01.445797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535b78-180b-4bb5-b9e8-14c8794da5fe admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:01.450900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535b78-180b-4bb5-b9e8-14c8794da5fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:01.450900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70535b78-180b-4bb5-b9e8-14c8794da5fe admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:01.450900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535b78-180b-4bb5-b9e8-14c8794da5fe admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:01.450900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70535b78-180b-4bb5-b9e8-14c8794da5fe admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:01.461728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1037/2108] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:01 2022] GET /identity/v3/roles => generated 1420 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:01.466210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:01.480437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be58cde8-244f-4683-a72e-4d56e41239b0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:01.485508 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:01.486497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:01.486787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:01.487069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] PATH_INFO: `/v3/projects/0eae3161931b4f9cbdbde19e611b7deb/users/e70190e9c845452e9dbeed8f06333724/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:01.489362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0eae3161931b4f9cbdbde19e611b7deb, user_id=e70190e9c845452e9dbeed8f06333724, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:01.492527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:01.506134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1072/2109] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:01 2022] PUT /identity/v3/projects/0eae3161931b4f9cbdbde19e611b7deb/users/e70190e9c845452e9dbeed8f06333724/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:01.516585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c083b-731e-4437-89c0-8c9e2e49aa2e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:01.517448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c083b-731e-4437-89c0-8c9e2e49aa2e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:01.518533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-960c083b-731e-4437-89c0-8c9e2e49aa2e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:01.548933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-960c083b-731e-4437-89c0-8c9e2e49aa2e None None] MFA Rules not processed for user `e70190e9c845452e9dbeed8f06333724`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:01.550877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-960c083b-731e-4437-89c0-8c9e2e49aa2e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:01.584932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:01.646791 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1038/2110] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:01 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:01.664593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:01.664593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:01.734708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da69ceac-7240-4019-aef8-c1cd1272a8f4 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:01.739600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:01.740283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:01.740565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:01.740873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:01.751888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:01.753362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:01.765017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1073/2111] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:01 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:01.783769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:01.784063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:01.784528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:01.803557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] MFA Rules not processed for user `5aa93da151774e5eaa092cdc5d445dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:01.804743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:01.867877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1039/2112] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:01 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:02.541460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:02.686985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c92afff-ea4a-41e8-a65c-87439e735b5e service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:02.695872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:02.697978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:02.698723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:02.699395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] PATH_INFO: `/v3/users/12dbc72b04034137997a310e0e561df1` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:02.701303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] RBAC: Authorizing `identity:delete_user(user_id=12dbc72b04034137997a310e0e561df1)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:02.717599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:02.867498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:02.869162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:02.883457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb96d43-b37b-4d76-b886-e538e15f4864 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:02.888146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:02.889063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:02.889372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:02.889646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] PATH_INFO: `/v3/users/2f16aad535d24fb9ae80be3997b40896` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:02.890914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] RBAC: Authorizing `identity:delete_user(user_id=2f16aad535d24fb9ae80be3997b40896)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:02.893416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:02.920334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '12dbc72b04034137997a310e0e561df1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:02.932348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '12dbc72b04034137997a310e0e561df1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:02.939421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '12dbc72b04034137997a310e0e561df1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:02.940156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '12dbc72b04034137997a310e0e561df1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.024828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-968716e8-c70d-40ec-ad7b-b47e1a76a038 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '12dbc72b04034137997a310e0e561df1'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.031670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1074/2113] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:02 2022] DELETE /identity/v3/users/12dbc72b04034137997a310e0e561df1 => generated 0 bytes in 491 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:03.036316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:03.036659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:03.036942 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:03.056794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:03.056794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:03.091697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2f16aad535d24fb9ae80be3997b40896'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.098832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2f16aad535d24fb9ae80be3997b40896'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.117424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2f16aad535d24fb9ae80be3997b40896'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.118297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2f16aad535d24fb9ae80be3997b40896'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.120701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1075/2114] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:03.131858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:03.133271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:03.191103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8bbc018-94e4-4846-9974-9724575e6ec4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:03.194764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:03.195457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:03.195570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2cb9ccb9-d67e-42ff-8303-4d4ac7ff874a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2f16aad535d24fb9ae80be3997b40896'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:03.195741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:03.196011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:03.197901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:03.202415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1040/2115] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:02 2022] DELETE /identity/v3/users/2f16aad535d24fb9ae80be3997b40896 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:03.207431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:03.207729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:03.208013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:03.212071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:03.213582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:03.228917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:03.237548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:03.244399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1076/2116] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:17:03.316998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1041/2117] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:03.338956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:03.341615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:03.363695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0e07eb7-629e-4b84-9e9a-0bd1e1fc20c6 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:03.465055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:03.465770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:03.466187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:03.466484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:03.478437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:03.479963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:03.489987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1077/2118] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:03.807999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:03.811428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:03.839208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f77e0455-95c8-41b1-89d4-fd56f0de5017 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:03.842509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:03.843612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:03.843747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:03.844141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] PATH_INFO: `/v3/projects/c73fa07723ae421181ad8b0755150e78` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:03.845398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c73fa07723ae421181ad8b0755150e78)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:03.847392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:03.893689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:04.008787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:04.010585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:04.026396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849dd6ad-d93d-4eba-8d51-138bb929989d service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:04.031390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:04.032307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:04.032632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:04.032911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] PATH_INFO: `/v3/projects/319f0c0588a74e26bc21b26aba099562` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:04.045892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] RBAC: Authorizing `identity:delete_project(project_id=319f0c0588a74e26bc21b26aba099562)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:04.045892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:04.058872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c73fa07723ae421181ad8b0755150e78', 'request_id': 'req-f797c49e-4643-4f1d-8989-f98dccac31e5'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.065593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c73fa07723ae421181ad8b0755150e78', 'request_id': 'req-f797c49e-4643-4f1d-8989-f98dccac31e5'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.072104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c73fa07723ae421181ad8b0755150e78', 'request_id': 'req-f797c49e-4643-4f1d-8989-f98dccac31e5'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.187004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] The token cache is being invalidate because project c73fa07723ae421181ad8b0755150e78 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:04.187381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.188063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.190464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1042/2119] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:03 2022] DELETE /identity/v3/projects/c73fa07723ae421181ad8b0755150e78 => generated 0 bytes in 384 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:04.194398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:04.196109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:04.203368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '319f0c0588a74e26bc21b26aba099562', 'request_id': 'req-57a8e101-56a8-47c1-bee0-37f708ebabaa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.213596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '319f0c0588a74e26bc21b26aba099562', 'request_id': 'req-57a8e101-56a8-47c1-bee0-37f708ebabaa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.223252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '319f0c0588a74e26bc21b26aba099562', 'request_id': 'req-57a8e101-56a8-47c1-bee0-37f708ebabaa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.269901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f797c49e-4643-4f1d-8989-f98dccac31e5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:04.318648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] The token cache is being invalidate because project 319f0c0588a74e26bc21b26aba099562 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:04.319035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.319740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.321492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1078/2120] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:04 2022] DELETE /identity/v3/projects/319f0c0588a74e26bc21b26aba099562 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:04.325286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:04.326664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:04.327868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:04.328762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:04.329050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:04.329329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] PATH_INFO: `/v3/users/e70190e9c845452e9dbeed8f06333724` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:04.330612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e70190e9c845452e9dbeed8f06333724)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:04.332512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:04.341279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57a8e101-56a8-47c1-bee0-37f708ebabaa admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:04.346308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:04.349892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:04.349892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:04.349892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] PATH_INFO: `/v3/users/fe1f797fd64a44c185b5a5ef52e7daba` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:04.349892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe1f797fd64a44c185b5a5ef52e7daba)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:04.351470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:04.540604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e70190e9c845452e9dbeed8f06333724'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.542470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe1f797fd64a44c185b5a5ef52e7daba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.557064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e70190e9c845452e9dbeed8f06333724'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.562297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe1f797fd64a44c185b5a5ef52e7daba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.569860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe1f797fd64a44c185b5a5ef52e7daba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.570648 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe1f797fd64a44c185b5a5ef52e7daba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.572034 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e70190e9c845452e9dbeed8f06333724'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.572881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e70190e9c845452e9dbeed8f06333724'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.657192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe1f797fd64a44c185b5a5ef52e7daba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.664668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1079/2121] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:04 2022] DELETE /identity/v3/users/fe1f797fd64a44c185b5a5ef52e7daba => generated 0 bytes in 340 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:04.701664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e70190e9c845452e9dbeed8f06333724'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:04.701946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=5,keystone:SELECT=90,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:04.709754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1043/2122] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:04 2022] DELETE /identity/v3/users/e70190e9c845452e9dbeed8f06333724 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:05.168971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.170824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:05.258398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0319e97-62d1-4e94-8ec2-0d7ce796aefa admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.314608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.315459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.315734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.316005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] PATH_INFO: `/v3/projects/3aa07cfd75b141c29da2b5fa10fdbafa` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.317178 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aa07cfd75b141c29da2b5fa10fdbafa)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.319110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.351561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.353045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:05.369627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ae0611f-6f64-49e0-b351-d3f9578260d9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.375534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.376796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.377077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.377351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] PATH_INFO: `/v3/projects/0eae3161931b4f9cbdbde19e611b7deb` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.382341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=0eae3161931b4f9cbdbde19e611b7deb)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.382341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.421707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aa07cfd75b141c29da2b5fa10fdbafa', 'request_id': 'req-d84ddc43-1e3f-40f4-9d62-f6c090540a13'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.427617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aa07cfd75b141c29da2b5fa10fdbafa', 'request_id': 'req-d84ddc43-1e3f-40f4-9d62-f6c090540a13'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.436175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aa07cfd75b141c29da2b5fa10fdbafa', 'request_id': 'req-d84ddc43-1e3f-40f4-9d62-f6c090540a13'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.496431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0eae3161931b4f9cbdbde19e611b7deb', 'request_id': 'req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.502725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0eae3161931b4f9cbdbde19e611b7deb', 'request_id': 'req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.509349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0eae3161931b4f9cbdbde19e611b7deb', 'request_id': 'req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.516669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] The token cache is being invalidate because project 3aa07cfd75b141c29da2b5fa10fdbafa was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:05.517633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.522403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d84ddc43-1e3f-40f4-9d62-f6c090540a13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.522403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1080/2123] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:05 2022] DELETE /identity/v3/projects/3aa07cfd75b141c29da2b5fa10fdbafa => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:05.524938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3195a50-9fae-4435-a1ed-3eea15afb0b4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.525228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3195a50-9fae-4435-a1ed-3eea15afb0b4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.525506 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3195a50-9fae-4435-a1ed-3eea15afb0b4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.544679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e3195a50-9fae-4435-a1ed-3eea15afb0b4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:05.546321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e3195a50-9fae-4435-a1ed-3eea15afb0b4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:05.614378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1081/2124] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:05.616305 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] The token cache is being invalidate because project 0eae3161931b4f9cbdbde19e611b7deb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:05.616856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.617529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cb7b6fe5-36b8-4b64-87c7-048c269da8fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:05.619087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1044/2125] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:05 2022] DELETE /identity/v3/projects/0eae3161931b4f9cbdbde19e611b7deb => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:05.623979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9109c-f366-4c4c-9574-c4744f29792d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.624436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9109c-f366-4c4c-9574-c4744f29792d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.624719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4da9109c-f366-4c4c-9574-c4744f29792d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.628558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.629020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.629485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.646120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4da9109c-f366-4c4c-9574-c4744f29792d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:05.647246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4da9109c-f366-4c4c-9574-c4744f29792d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:05.651952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:05.655041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:05.666931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1082/2126] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:05.668737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.669035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.669453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.669685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1045/2127] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:05.675728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.685693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26fe2e17-2b2f-4dea-b70b-4f1e77547a7c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.693502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.694342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.694921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.695527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.697269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:17:05.697648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.699499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:05.701953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.702159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:05.714756 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1083/2128] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:05.720588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1046/2129] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:17:05.720760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.723009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.734356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-231a23ef-eeab-44e4-9cff-48572bf6f92a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.735143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-289f8cb3-40ea-4d60-813d-4253f524d468 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.739923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.740388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.740729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.741043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.741166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.741336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.741742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.741882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.742617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:17:05.742955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.744538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.745971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.748181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.759161 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1084/2130] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:17:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:17:05.763192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.773434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623628b7-7673-4e5e-b03e-301ddb5f91ad admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.777971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.778759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.779040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.779315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.780003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.782282 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.855212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1047/2131] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:05.859242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.911385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1085/2132] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/projects => generated 385 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:17:05.912438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:05.921196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d798f91d-ec54-4559-ad02-f75d43c56b65 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.982723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.983332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.983616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.983726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79ca68aa-c2bd-4cab-a987-23effa1eedc7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:05.984301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.985249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.988191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:05.990463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:05.991139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:05.996100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:05.996100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:05.996100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:05.996100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.014902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:06.089933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1048/2133] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/users => generated 282 bytes in 231 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:17:06.093860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.106827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ebcf338-1041-4f8f-b4a2-c43ec169da61 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.107476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1086/2134] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:05 2022] POST /identity/v3/users => generated 293 bytes in 195 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:06.111964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.115003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.115694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.115980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.116258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.117243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.122178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.122289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8b78c0-895a-4a94-84b2-a597a459e3c8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.126945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.127578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.127862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.128143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.128870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.128989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1049/2135] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:06.130536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.132758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.140939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1087/2136] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:06.142759 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f7fc7b9-1041-4e4e-98f6-a6eecf45f701 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.144583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.147609 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.148254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.148543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.148820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.149588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.151271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.154736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a393350b-4236-41aa-9848-2e128d091cc0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.165823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1050/2137] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:06.166901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.168145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.168850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.169345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.169888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.170254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.171889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.178072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-577eac0f-6a21-4450-b77b-08506126c804 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.182765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6552656f-7cc9-42c3-9b19-209215357414 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.183646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552656f-7cc9-42c3-9b19-209215357414 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.187060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1088/2138] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:06 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:06.187166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552656f-7cc9-42c3-9b19-209215357414 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.187166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6552656f-7cc9-42c3-9b19-209215357414 admin admin] PATH_INFO: `/v3/projects/3517048aa5b54df184e08b551ba2eb38/users/952e3cfbb5e14b9190c9dbff0d62f152/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.187897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.197720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f36188dc-a2d2-4f2c-b021-cee63f9dd080 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.199277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552656f-7cc9-42c3-9b19-209215357414 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3517048aa5b54df184e08b551ba2eb38, user_id=952e3cfbb5e14b9190c9dbff0d62f152, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.202049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6552656f-7cc9-42c3-9b19-209215357414 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.202438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeff93c6-5860-4f55-8e90-570b7a8b109d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.205737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff93c6-5860-4f55-8e90-570b7a8b109d admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.205737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff93c6-5860-4f55-8e90-570b7a8b109d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.205737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeff93c6-5860-4f55-8e90-570b7a8b109d admin admin] PATH_INFO: `/v3/projects/e2ed17a201254f31b40ea4b948993e70/users/f99a7bf097c949d0b7829d99e036129b/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.218385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff93c6-5860-4f55-8e90-570b7a8b109d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e2ed17a201254f31b40ea4b948993e70, user_id=f99a7bf097c949d0b7829d99e036129b, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.221619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeff93c6-5860-4f55-8e90-570b7a8b109d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.308038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1051/2139] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:06 2022] PUT /identity/v3/projects/3517048aa5b54df184e08b551ba2eb38/users/952e3cfbb5e14b9190c9dbff0d62f152/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 139 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:06.317507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.317815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.318164 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.323408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1089/2140] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:06 2022] PUT /identity/v3/projects/e2ed17a201254f31b40ea4b948993e70/users/f99a7bf097c949d0b7829d99e036129b/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:06.334748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.335495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.335495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.365146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] MFA Rules not processed for user `952e3cfbb5e14b9190c9dbff0d62f152`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:06.367068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:06.376159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] MFA Rules not processed for user `f99a7bf097c949d0b7829d99e036129b`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:06.377776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:06.429373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:06.456890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1090/2141] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:06.468367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.469858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:06.476101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1052/2142] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:06 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:06.515449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.517393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:06.536884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e426f9df-f910-46ec-972b-51329485eac9 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.540487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.541131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.541412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.541688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.551820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.553273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.564706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1091/2143] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:06 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 95 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:06.578880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794f0bd4-fe18-4504-8f27-acfa9f908dd4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.584840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25dadc2c-9d8c-4490-8132-1dd969b4c6a8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.586073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadc2c-9d8c-4490-8132-1dd969b4c6a8 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.586073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadc2c-9d8c-4490-8132-1dd969b4c6a8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.586427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25dadc2c-9d8c-4490-8132-1dd969b4c6a8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.598272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dadc2c-9d8c-4490-8132-1dd969b4c6a8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.598651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:06.599727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25dadc2c-9d8c-4490-8132-1dd969b4c6a8 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.609406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1053/2144] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:06 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:17:06.682819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e124ca16-f838-4bde-9679-c9f03aefa0c1 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:06.687522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:06.688397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:06.688706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:06.688974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] PATH_INFO: `/v3/users/f99a7bf097c949d0b7829d99e036129b` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:06.690234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f99a7bf097c949d0b7829d99e036129b)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:06.692197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:06.903922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f99a7bf097c949d0b7829d99e036129b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:06.916975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f99a7bf097c949d0b7829d99e036129b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:06.924632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f99a7bf097c949d0b7829d99e036129b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:06.925356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f99a7bf097c949d0b7829d99e036129b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:06.986541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f99a7bf097c949d0b7829d99e036129b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:06.995587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1092/2145] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:06 2022] DELETE /identity/v3/users/f99a7bf097c949d0b7829d99e036129b => generated 0 bytes in 397 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:07.000321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:07.000615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:07.000894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:07.019625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:07.020824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:07.081167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1054/2146] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:07.091812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:07.091812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:07.092327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:07.150513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:07.172082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca72844e-2062-4680-a0c5-8bf66a370269 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:07.172082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c983d1c0-249c-45d0-bf6f-a8b8a28ac1f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:07.172082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983d1c0-249c-45d0-bf6f-a8b8a28ac1f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:07.172082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983d1c0-249c-45d0-bf6f-a8b8a28ac1f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:07.172879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c983d1c0-249c-45d0-bf6f-a8b8a28ac1f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:07.180583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983d1c0-249c-45d0-bf6f-a8b8a28ac1f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:07.182070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c983d1c0-249c-45d0-bf6f-a8b8a28ac1f3 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:07.193997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1093/2147] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:07.757448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:07.759019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:07.775325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9190db14-13a1-4af8-a7a0-ae8178b44e50 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:07.781091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:07.784627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:07.785111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:07.785533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] PATH_INFO: `/v3/projects/e2ed17a201254f31b40ea4b948993e70` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:07.787156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e2ed17a201254f31b40ea4b948993e70)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:07.789146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:07.911301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e2ed17a201254f31b40ea4b948993e70', 'request_id': 'req-b41e8a1c-2577-4c93-866d-34049042a13b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:07.923448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e2ed17a201254f31b40ea4b948993e70', 'request_id': 'req-b41e8a1c-2577-4c93-866d-34049042a13b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:07.928807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e2ed17a201254f31b40ea4b948993e70', 'request_id': 'req-b41e8a1c-2577-4c93-866d-34049042a13b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:08.037867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] The token cache is being invalidate because project e2ed17a201254f31b40ea4b948993e70 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:08.038202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:08.038884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:08.040572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1055/2148] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:07 2022] DELETE /identity/v3/projects/e2ed17a201254f31b40ea4b948993e70 => generated 0 bytes in 284 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:08.687464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:08.816021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=1,keystone:DELETE=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:09.284042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:10.809984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:11.038865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:11.295305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2125b8-db15-43a9-829f-982ee70d81aa None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:11.298668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2125b8-db15-43a9-829f-982ee70d81aa None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:11.298668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a2125b8-db15-43a9-829f-982ee70d81aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:11.335434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4a2125b8-db15-43a9-829f-982ee70d81aa None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:11.344651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4a2125b8-db15-43a9-829f-982ee70d81aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:11.409503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1094/2149] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:17:11 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:11.473148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:11.478197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:11.570223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b41e8a1c-2577-4c93-866d-34049042a13b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:11.575680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:11.576533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:11.576819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:11.577869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:11.585866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:11.587511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:11.597768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1056/2150] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:17:11 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 125 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 17:17:11.952826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:12.361848 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:12.487348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a42e2-2b74-4a01-87cc-d293ecf5ad4a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:12.487642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a42e2-2b74-4a01-87cc-d293ecf5ad4a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:12.487929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481a42e2-2b74-4a01-87cc-d293ecf5ad4a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:12.505856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-481a42e2-2b74-4a01-87cc-d293ecf5ad4a None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:12.507089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-481a42e2-2b74-4a01-87cc-d293ecf5ad4a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:12.514298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1095/2151] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 6 17:17:12 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:12.527905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:12.540049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36d12ade-fc23-4234-91b7-075fad69de47 service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:12.547123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:12.547775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:12.548056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:12.548518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:12.558192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:12.559957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:12.568605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1057/2152] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:17:12 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:17:12.687379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:INSERT=5,keystone:DELETE=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:13.374787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997eff-2b15-4da4-88bd-e4e24db76648 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:13.375359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997eff-2b15-4da4-88bd-e4e24db76648 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:13.375359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8997eff-2b15-4da4-88bd-e4e24db76648 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:13.394112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e8997eff-2b15-4da4-88bd-e4e24db76648 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:13.395492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e8997eff-2b15-4da4-88bd-e4e24db76648 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:13.404040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1096/2153] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:17:13 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:13.415706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:13.426922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b31f4ce-6808-44d9-8c76-2dafdba1bf1e service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:13.441636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:13.442325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:13.442610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:13.442895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:13.451651 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:13.453401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:13.461850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1058/2154] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:17:13 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:17:13.510096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:13.758717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=9,keystone:SELECT=90,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:14.103003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:14.103295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:14.103583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:14.121388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:14.122564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:14.129999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1097/2155] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 6 17:17:14 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:14.142541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:14.153118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce49d11-875a-4e19-a82d-0cef023aec13 service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:14.159221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5964fb-fe23-4bed-b425-5e424c81d5fb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:14.159861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5964fb-fe23-4bed-b425-5e424c81d5fb service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:14.160172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5964fb-fe23-4bed-b425-5e424c81d5fb service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:14.160447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5964fb-fe23-4bed-b425-5e424c81d5fb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:14.168675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5964fb-fe23-4bed-b425-5e424c81d5fb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:14.170276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5964fb-fe23-4bed-b425-5e424c81d5fb service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:14.178241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1059/2156] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:17:14 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:17:14.629625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:14.772735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:15.992999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=86,keystone:DELETE=12,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:16.781203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:17.021195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:17.022623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:17.088875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-527f6492-577d-469b-bbf2-31a3382d05b2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:17.093390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:17.095710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:17.095710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:17.095710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] PATH_INFO: `/v3/users/375e9d0bcc0d49e8ba88a2127f4acfd6` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:17.096893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] RBAC: Authorizing `identity:delete_user(user_id=375e9d0bcc0d49e8ba88a2127f4acfd6)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:17.098856 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:17.172925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:17.294626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '375e9d0bcc0d49e8ba88a2127f4acfd6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.310185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '375e9d0bcc0d49e8ba88a2127f4acfd6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.317922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '375e9d0bcc0d49e8ba88a2127f4acfd6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.318716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '375e9d0bcc0d49e8ba88a2127f4acfd6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.386217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '375e9d0bcc0d49e8ba88a2127f4acfd6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.393690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1098/2157] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:17 2022] DELETE /identity/v3/users/375e9d0bcc0d49e8ba88a2127f4acfd6 => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:17.398206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:17.398503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:17.398787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:17.417198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:17.417793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:17.478441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1060/2158] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:17.487951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:17.489438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:17.545889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3c9791-eaee-43e4-9fdc-a5fab6716a4c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:17.549625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfad2af-4054-4af7-9e62-7a073b32ec3c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:17.550254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad2af-4054-4af7-9e62-7a073b32ec3c service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:17.550578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad2af-4054-4af7-9e62-7a073b32ec3c service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:17.550864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfad2af-4054-4af7-9e62-7a073b32ec3c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:17.559813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:17.562269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad2af-4054-4af7-9e62-7a073b32ec3c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:17.569050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfad2af-4054-4af7-9e62-7a073b32ec3c service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:17.574008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1099/2159] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:17:17.812965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=3,keystone:SELECT=92,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:17.821589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:17.823062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:17.838921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a8b1d6-dbce-40cf-9bc6-1b3259989569 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:17.845373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:17.846242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:17.846582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:17.846919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] PATH_INFO: `/v3/projects/3aba620cd55241b5ac8d36b1ead0c9db` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:17.848452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3aba620cd55241b5ac8d36b1ead0c9db)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:17.850506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:17.886967 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:17.950877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3aba620cd55241b5ac8d36b1ead0c9db', 'request_id': 'req-6bee289e-23db-4075-901f-9d9b06e04005'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.956564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3aba620cd55241b5ac8d36b1ead0c9db', 'request_id': 'req-6bee289e-23db-4075-901f-9d9b06e04005'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:17.963277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3aba620cd55241b5ac8d36b1ead0c9db', 'request_id': 'req-6bee289e-23db-4075-901f-9d9b06e04005'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:18.075383 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] The token cache is being invalidate because project 3aba620cd55241b5ac8d36b1ead0c9db was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:18.075718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:18.076367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6bee289e-23db-4075-901f-9d9b06e04005 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:18.077942 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1061/2160] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:17 2022] DELETE /identity/v3/projects/3aba620cd55241b5ac8d36b1ead0c9db => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:18.083022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.083305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.083631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.102045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:18.103307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:18.166793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1100/2161] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:18.173693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.174208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.174410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.195457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:18.196159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:18.205271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1062/2162] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:18.209482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.220565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2024e81e-5aa6-41d1-b518-85426ec9a184 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:18.225998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:18.226737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.226973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.227831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.228126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:17:18.228439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:18.230156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:18.246205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1101/2163] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:17:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:17:18.249560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.259703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d37d044-6e20-4c49-9d60-7b8de0f274e2 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:18.265603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:18.266760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.267390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.268213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.269242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:18.271289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:18.374096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1063/2164] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:18 2022] POST /identity/v3/projects => generated 385 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:18.377005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.387231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c91ab01-0196-4f97-8cdb-e18b517bb2bf admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:18.453835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:18.455811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.455811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.455811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.456545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:18.458499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:18.573527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1102/2165] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:18 2022] POST /identity/v3/users => generated 293 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:17:18.577786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.588842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64d5eda-fdd2-4754-abf3-8546def56b97 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:18.604638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:18.605762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.606159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.606451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.607228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:18.608917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:18.620402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1064/2166] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:18.624663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.635790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f2afae-e6f8-45db-993d-43f467630416 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:18.641009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5765ff73-f53f-430d-8738-377e5ed98d71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:18.647344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ff73-f53f-430d-8738-377e5ed98d71 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.647344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ff73-f53f-430d-8738-377e5ed98d71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.647344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5765ff73-f53f-430d-8738-377e5ed98d71 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.647344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765ff73-f53f-430d-8738-377e5ed98d71 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:18.647344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5765ff73-f53f-430d-8738-377e5ed98d71 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:18.666960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1103/2167] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:18 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:18.676852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:18.679872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.690344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06792057-24d9-430e-a9a1-4d444943d60d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:18.699760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:18.699760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.699760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.699760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] PATH_INFO: `/v3/projects/1876774ff79e4a0da6706b9d521a3731/users/de7b3f1c5f0741a58cca937405a821ed/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.715088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1876774ff79e4a0da6706b9d521a3731, user_id=de7b3f1c5f0741a58cca937405a821ed, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:18.728375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:18.862577 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:18.876357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1065/2168] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:18 2022] PUT /identity/v3/projects/1876774ff79e4a0da6706b9d521a3731/users/de7b3f1c5f0741a58cca937405a821ed/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:18.876477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430de09c-aa4c-4219-b156-ce17513426cf None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:18.876477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430de09c-aa4c-4219-b156-ce17513426cf None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:18.876477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-430de09c-aa4c-4219-b156-ce17513426cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:18.894819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-430de09c-aa4c-4219-b156-ce17513426cf None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:18.897012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-430de09c-aa4c-4219-b156-ce17513426cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:18.976532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1104/2169] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:18.987304 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:18.989460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:19.048499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0b8b8b4-dbc3-4a2b-bbd3-add32f99e051 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:19.052240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:19.052891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:19.053184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:19.053476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:19.071122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:19.071122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:19.073583 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1066/2170] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:19.398300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:19.701890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:DELETE=3,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:26.368724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:26.369272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:26.369272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:26.420121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] MFA Rules not processed for user `de7b3f1c5f0741a58cca937405a821ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:26.421641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:26.561260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1105/2171] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:26 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:26.565920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:26.578132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77cdce06-4cc5-45c0-a0f9-4580e76e0db1 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:26.583963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:26.584818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:26.585123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:26.585499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:26.586323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:26.588484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:26.606962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:26.735875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1067/2172] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:26 2022] POST /identity/v3/projects => generated 383 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:17:26.740090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:26.762785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b193a26-cd81-46d8-9c42-ecd3b6c1590e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:26.895514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:26.896272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:26.896623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:26.896970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:26.897826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:26.899891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:26.909936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:27.021703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1106/2173] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:26 2022] POST /identity/v3/users => generated 298 bytes in 280 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:27.023022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:27.033870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca951a3-b9b2-42cb-8b2a-2cce4371c703 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:27.038923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72fe2a9-e55d-4937-b80b-7244eb177eea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:27.039746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fe2a9-e55d-4937-b80b-7244eb177eea admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:27.040101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fe2a9-e55d-4937-b80b-7244eb177eea admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:27.040491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72fe2a9-e55d-4937-b80b-7244eb177eea admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:27.041294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fe2a9-e55d-4937-b80b-7244eb177eea admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:27.043149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72fe2a9-e55d-4937-b80b-7244eb177eea admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:27.058132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1068/2174] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:27.060987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:27.071232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e7f86f-4ae4-4dfe-beb2-5a650cd7708d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:27.075909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:27.076902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:27.077226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:27.077510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] PATH_INFO: `/v3/projects/8e50a26260624e71b71a8891d63e322a/users/735ed165da76433eba0116c15d354181/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:27.093735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50a26260624e71b71a8891d63e322a, user_id=735ed165da76433eba0116c15d354181, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:27.100057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:27.129706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:27.130095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:27.130384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:27.150011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] MFA Rules not processed for user `9d3ca58b09634edc9e093d9d9eb0ee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:27.151656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:27.194143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1107/2175] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:27 2022] PUT /identity/v3/projects/8e50a26260624e71b71a8891d63e322a/users/735ed165da76433eba0116c15d354181/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:27.198383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:27.233903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1069/2176] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:27 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:27.294720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f6ff238-947f-4c2b-834d-ea5f00083209 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:27.301421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:27.302136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:27.302423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:27.302705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:27.308238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:27.308238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:27.318344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1108/2177] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:27 2022] GET /identity/v3/roles => generated 1420 bytes in 121 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:17:27.323032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:27.335130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2afbe9dd-a6d5-4f23-a7e1-87ccde185bac None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:27.342158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6bd2ba-1e0d-4595-92a8-bcbacf759c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:27.343074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd2ba-1e0d-4595-92a8-bcbacf759c87 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:27.343355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd2ba-1e0d-4595-92a8-bcbacf759c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:27.343633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6bd2ba-1e0d-4595-92a8-bcbacf759c87 admin admin] PATH_INFO: `/v3/projects/8e50a26260624e71b71a8891d63e322a/users/735ed165da76433eba0116c15d354181/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:27.345926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd2ba-1e0d-4595-92a8-bcbacf759c87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8e50a26260624e71b71a8891d63e322a, user_id=735ed165da76433eba0116c15d354181, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:27.348747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6bd2ba-1e0d-4595-92a8-bcbacf759c87 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:27.378993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1070/2178] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:27 2022] PUT /identity/v3/projects/8e50a26260624e71b71a8891d63e322a/users/735ed165da76433eba0116c15d354181/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:28.193798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:28.196437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:28.218950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200e5bb8-f24d-4ad0-add7-d524f6fb3833 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:28.321745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:28.322896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:28.323271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:28.323446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] PATH_INFO: `/v3/users/7d3b51bf0b21434b9d951cf60bbbd11c` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:28.324733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7d3b51bf0b21434b9d951cf60bbbd11c)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:28.327064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:28.578573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7d3b51bf0b21434b9d951cf60bbbd11c'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:28.658774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7d3b51bf0b21434b9d951cf60bbbd11c'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:28.667860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=90,keystone:INSERT=1,keystone:DELETE=9 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:28.674162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7d3b51bf0b21434b9d951cf60bbbd11c'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:28.675302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7d3b51bf0b21434b9d951cf60bbbd11c'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:28.781070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7d3b51bf0b21434b9d951cf60bbbd11c'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:28.792879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1109/2179] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:28 2022] DELETE /identity/v3/users/7d3b51bf0b21434b9d951cf60bbbd11c => generated 0 bytes in 599 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:28.800300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:28.800765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:28.800878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:28.838539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:28.839951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:28.946161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1071/2180] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:28.956923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:28.958761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:29.042223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5af90f41-c8f4-4730-a9f1-7812a04b3e81 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:29.059400 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8367b77c-79c7-4ba4-8f66-a909cd72387b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:29.074928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b77c-79c7-4ba4-8f66-a909cd72387b service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:29.075233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b77c-79c7-4ba4-8f66-a909cd72387b service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:29.075521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8367b77c-79c7-4ba4-8f66-a909cd72387b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:29.115721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367b77c-79c7-4ba4-8f66-a909cd72387b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:29.117477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8367b77c-79c7-4ba4-8f66-a909cd72387b service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:29.165837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1110/2181] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:30.389284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:30.394945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:30.414434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-147e890f-f850-4d7d-b507-ab8195cd33b7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:30.435793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:30.436693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:30.436981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:30.437266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] PATH_INFO: `/v3/projects/77779ef42df74c4d801a81e7209769d2` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:30.438906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=77779ef42df74c4d801a81e7209769d2)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:30.441359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:30.612952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '77779ef42df74c4d801a81e7209769d2', 'request_id': 'req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:30.631385 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '77779ef42df74c4d801a81e7209769d2', 'request_id': 'req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:30.640840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '77779ef42df74c4d801a81e7209769d2', 'request_id': 'req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:30.730433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:INSERT=3,keystone:SELECT=90,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:30.735593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] The token cache is being invalidate because project 77779ef42df74c4d801a81e7209769d2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:30.735894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:30.736738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8dcfdc4f-a815-4b9d-92ae-e235b5d16a2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:30.738338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1072/2182] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:30 2022] DELETE /identity/v3/projects/77779ef42df74c4d801a81e7209769d2 => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:30.743718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:30.744198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:30.744306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:30.770500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:30.771977 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:30.929499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:30.930144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1111/2183] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:30.930637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:30.934195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:30.970364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:30.973546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:30.998410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1073/2184] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:17:31.003728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.016519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9592f0b8-af08-4c1a-b4a3-70ec389d5493 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.042009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.043224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.043224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.043470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.049254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:17:31.049793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.051615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.066108 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1112/2185] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:17:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:17:31.075237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.088880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521ff9b8-21b7-4edc-9d7d-d8c9292928e1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.119295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.123059 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.123627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.144338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.146691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.149308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.264986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1074/2186] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:31 2022] POST /identity/v3/projects => generated 397 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:31.268679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.284444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a45824-9f49-4671-b3e6-16906d8a8ba6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.373228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.374302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.377172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.377172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.377172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.379294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.461728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1113/2187] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:31 2022] POST /identity/v3/users => generated 299 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:31.463051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.473892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b4b96c-71fb-44a2-9dfa-f14fdb7b65a6 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.478830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.479580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.480105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.480381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.481309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.483933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.503078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1075/2188] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:31.507494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.519468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec7a4075-27e9-4038-8fcc-34dbae148829 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.534707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c213e4c-e6d3-46d8-ab5c-eaf6441def4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.535402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213e4c-e6d3-46d8-ab5c-eaf6441def4e admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.535691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213e4c-e6d3-46d8-ab5c-eaf6441def4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.535972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c213e4c-e6d3-46d8-ab5c-eaf6441def4e admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.536720 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c213e4c-e6d3-46d8-ab5c-eaf6441def4e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.538422 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c213e4c-e6d3-46d8-ab5c-eaf6441def4e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.539991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=4,keystone:DELETE=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:31.554652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1114/2189] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:31 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:31.556647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.566801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-400ada7f-e6a6-4af4-a5d4-c24a34028bb0 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.572817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.574156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.574727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.575197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] PATH_INFO: `/v3/projects/02341606077143cbab85938abe804cbd/users/346774fe5d87455494fe20386fec5318/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.590903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02341606077143cbab85938abe804cbd, user_id=346774fe5d87455494fe20386fec5318, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.593699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.653975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1076/2190] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:31 2022] PUT /identity/v3/projects/02341606077143cbab85938abe804cbd/users/346774fe5d87455494fe20386fec5318/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:31.669268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186dee4-cc09-4818-b569-68c233654108 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.669488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186dee4-cc09-4818-b569-68c233654108 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.669764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8186dee4-cc09-4818-b569-68c233654108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.714349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8186dee4-cc09-4818-b569-68c233654108 None None] MFA Rules not processed for user `346774fe5d87455494fe20386fec5318`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:31.714349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8186dee4-cc09-4818-b569-68c233654108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:31.805091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1115/2191] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:31 2022] POST /identity/v3/auth/tokens => generated 3264 bytes in 137 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:31.817653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:31.822631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:31.906094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a28f4076-84a3-42e0-8c57-b696a3bbf309 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:31.911186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:31.911868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:31.912153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:31.912435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:31.931037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:31.932334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:31.960663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1077/2192] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:31 2022] GET /identity/v3/auth/tokens => generated 3264 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:35.725202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8da8d-0788-4cb0-832b-8621001a9496 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:35.726106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8da8d-0788-4cb0-832b-8621001a9496 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:35.726612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb8da8d-0788-4cb0-832b-8621001a9496 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:35.757241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1eb8da8d-0788-4cb0-832b-8621001a9496 None None] MFA Rules not processed for user `735ed165da76433eba0116c15d354181`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:35.758498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1eb8da8d-0788-4cb0-832b-8621001a9496 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:35.854864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1116/2193] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:35.870019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:35.872703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:35.959027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70811b40-c940-464d-ade5-2fd9713dca6a service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:35.962837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:35.963718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:35.964191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:35.964629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:35.966736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:36.036337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:36.050279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:36.051966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:36.062632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1078/2194] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:36.308063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:36.309605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:36.309951 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:36.331868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:36.333094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:36.411621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1117/2195] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:17:36 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:36.424885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:36.427006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:36.566060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9cc53c-4698-45cd-9b05-d502ea634f4b service glance] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:36.575632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50c7e258-56f7-471d-ac2b-e6d3ae2f70cb service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:36.577293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e258-56f7-471d-ac2b-e6d3ae2f70cb service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:36.577921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e258-56f7-471d-ac2b-e6d3ae2f70cb service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:36.578423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50c7e258-56f7-471d-ac2b-e6d3ae2f70cb service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:36.590143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e258-56f7-471d-ac2b-e6d3ae2f70cb service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:36.592028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50c7e258-56f7-471d-ac2b-e6d3ae2f70cb service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:36.603157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1079/2196] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:17:36 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 179 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:17:38.400092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:38.431261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:38.568474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b352247c-71ac-48aa-b249-2ff8f1ba3331 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:38.574021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:38.575301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:38.575740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:38.576235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] PATH_INFO: `/v3/users/346774fe5d87455494fe20386fec5318` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:38.577684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] RBAC: Authorizing `identity:delete_user(user_id=346774fe5d87455494fe20386fec5318)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:38.579928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:38.831721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '346774fe5d87455494fe20386fec5318'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:38.847838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '346774fe5d87455494fe20386fec5318'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:38.856272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '346774fe5d87455494fe20386fec5318'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:38.857202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '346774fe5d87455494fe20386fec5318'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:38.992047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b011a158-a652-4f05-b451-5ef576aad03d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '346774fe5d87455494fe20386fec5318'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:39.000491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1118/2197] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:38 2022] DELETE /identity/v3/users/346774fe5d87455494fe20386fec5318 => generated 0 bytes in 601 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:39.005540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:39.005993 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:39.006375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:39.046591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:39.050268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:39.242282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1080/2198] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:39.246125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:39.246465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:39.246805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:39.259408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:39.264812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:39.291316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] MFA Rules not processed for user `c4815e3cdfc9485f8c8b0f1d0a0cc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:39.293551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:39.476092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68a35b8a-fbd2-4599-b6f4-24651e96520e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:39.477550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1119/2199] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:39 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:39.490840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:39.492037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:39.492535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:39.493063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:39.525803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:39.527402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:39.562194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1081/2200] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:40.392768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:40.395430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:40.414748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a77f5a6-cf73-4342-9c9a-47fb2f3ae00c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:40.426151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:40.431738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:40.432224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:40.434653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] PATH_INFO: `/v3/projects/02341606077143cbab85938abe804cbd` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:40.441624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02341606077143cbab85938abe804cbd)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:40.451058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:40.719858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:40.759045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02341606077143cbab85938abe804cbd', 'request_id': 'req-89042b9e-dd1f-4133-bc0a-ec004d130ff3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:40.783417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02341606077143cbab85938abe804cbd', 'request_id': 'req-89042b9e-dd1f-4133-bc0a-ec004d130ff3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:40.802962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02341606077143cbab85938abe804cbd', 'request_id': 'req-89042b9e-dd1f-4133-bc0a-ec004d130ff3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:40.921042 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] The token cache is being invalidate because project 02341606077143cbab85938abe804cbd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:40.921446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:40.922243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-89042b9e-dd1f-4133-bc0a-ec004d130ff3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:40.924834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1120/2201] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:40 2022] DELETE /identity/v3/projects/02341606077143cbab85938abe804cbd => generated 0 bytes in 533 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:44.851071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:44.866461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:44.895594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9f3f49b-0e5b-454e-96e4-db9653222462 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:44.930409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:44.976364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:44.977250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:44.977534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:44.977817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] PATH_INFO: `/v3/users/952e3cfbb5e14b9190c9dbff0d62f152` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:44.979052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=952e3cfbb5e14b9190c9dbff0d62f152)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:44.981494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:45.561912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '952e3cfbb5e14b9190c9dbff0d62f152'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:45.578748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '952e3cfbb5e14b9190c9dbff0d62f152'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:45.603714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '952e3cfbb5e14b9190c9dbff0d62f152'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:45.604921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '952e3cfbb5e14b9190c9dbff0d62f152'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:45.718379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '952e3cfbb5e14b9190c9dbff0d62f152'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:45.726123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1082/2202] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:17:44 2022] DELETE /identity/v3/users/952e3cfbb5e14b9190c9dbff0d62f152 => generated 0 bytes in 876 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:45.732310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:45.740888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:45.740888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:45.779180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:45.781033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:46.107248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1121/2203] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:46.107706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:46.107706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:46.268734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcd3fad2-2f61-4692-b403-26858b8649f7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:46.273582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa458e90-9022-4cb7-afaa-d73ac60e731a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:46.274697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e90-9022-4cb7-afaa-d73ac60e731a service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:46.275137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e90-9022-4cb7-afaa-d73ac60e731a service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:46.275606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa458e90-9022-4cb7-afaa-d73ac60e731a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:46.299506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458e90-9022-4cb7-afaa-d73ac60e731a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:46.304792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa458e90-9022-4cb7-afaa-d73ac60e731a service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:46.331430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1083/2204] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 248 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:47.832479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:47.834765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:47.862232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9a9db04-b2a6-4433-b9af-528aa28d1827 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:47.868075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:47.869318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:47.869822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:47.870335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] PATH_INFO: `/v3/projects/3517048aa5b54df184e08b551ba2eb38` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:47.871801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=3517048aa5b54df184e08b551ba2eb38)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:47.874410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:48.071211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3517048aa5b54df184e08b551ba2eb38', 'request_id': 'req-6765f866-bd55-4c88-b305-b1f3a946bf9b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:48.085231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3517048aa5b54df184e08b551ba2eb38', 'request_id': 'req-6765f866-bd55-4c88-b305-b1f3a946bf9b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:48.097078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3517048aa5b54df184e08b551ba2eb38', 'request_id': 'req-6765f866-bd55-4c88-b305-b1f3a946bf9b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:48.204870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] The token cache is being invalidate because project 3517048aa5b54df184e08b551ba2eb38 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:17:48.204870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:48.204870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6765f866-bd55-4c88-b305-b1f3a946bf9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:17:48.204870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1122/2205] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:17:47 2022] DELETE /identity/v3/projects/3517048aa5b54df184e08b551ba2eb38 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:17:48.209591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:48.210167 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:48.210537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:48.266746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:48.273608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:48.376471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:48.399878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1084/2206] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:48.408160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:48.413495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:48.413495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:48.437898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:48.439275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:48.459375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:48.460164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1123/2207] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:48.481977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-972f46e5-9d12-4795-87fd-f96df796bcba None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:48.502367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:48.503206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:48.503592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:48.503971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:48.504841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:17:48.505236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:48.514679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:48.546336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:48.551264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1085/2208] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:17:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:17:48.564887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e786730-0ab5-4cd2-bb69-81bbe8eca3e3 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:48.572800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:48.576265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:48.576265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:48.576265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:48.576265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:48.578195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:48.718256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1124/2209] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:17:48 2022] POST /identity/v3/projects => generated 381 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:48.718375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:48.734570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5538126-e567-4e8d-ac1a-da6f7f9aab8e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:48.964212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:48.965439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:48.966486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:48.967321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:48.968793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:48.972811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:49.079301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:49.100862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1086/2210] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:17:48 2022] POST /identity/v3/users => generated 291 bytes in 388 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:17:49.117658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e829dbc4-15c5-46bf-b950-989baae6f2fb admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:49.124303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:49.126493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:49.126982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:49.127586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:49.128594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:49.130477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:49.143811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1125/2211] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:49.148530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:49.160652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f32bd31-83f3-4beb-8d35-784633941c4b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:49.166294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f98a0-7dc1-48ee-9100-8cc100f488a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:49.167080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f98a0-7dc1-48ee-9100-8cc100f488a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:49.167904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f98a0-7dc1-48ee-9100-8cc100f488a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:49.168281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f98a0-7dc1-48ee-9100-8cc100f488a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:49.169174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f98a0-7dc1-48ee-9100-8cc100f488a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:49.170950 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f98a0-7dc1-48ee-9100-8cc100f488a9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:49.194581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:49.206124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1087/2212] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:17:49 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:17:49.209891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf8f1f87-dd97-4a54-a979-b8fc4417e85e admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:49.217146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:49.220166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:49.220630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:49.221092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] PATH_INFO: `/v3/projects/a9bf0eaeadc845889b942782a3a9663b/users/a72798fe70b34ae48470f15fcbe666a6/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:49.223733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:49.239800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a9bf0eaeadc845889b942782a3a9663b, user_id=a72798fe70b34ae48470f15fcbe666a6, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:49.245370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:49.347028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1126/2213] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:17:49 2022] PUT /identity/v3/projects/a9bf0eaeadc845889b942782a3a9663b/users/a72798fe70b34ae48470f15fcbe666a6/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:17:49.352260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6763-c887-4b14-afcd-55e78a68694c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:49.352779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6763-c887-4b14-afcd-55e78a68694c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:49.353547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36c6763-c887-4b14-afcd-55e78a68694c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:49.376784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-a36c6763-c887-4b14-afcd-55e78a68694c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:49.378795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a36c6763-c887-4b14-afcd-55e78a68694c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:49.480641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1088/2214] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:49.490885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:49.493556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:49.599851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f11b5ed8-1c42-464b-b1e8-8a441de53134 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:49.607946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23ff395e-10fe-40e3-9de9-41662bd19a24 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:49.608924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff395e-10fe-40e3-9de9-41662bd19a24 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:49.609219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff395e-10fe-40e3-9de9-41662bd19a24 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:49.609504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23ff395e-10fe-40e3-9de9-41662bd19a24 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:49.621854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff395e-10fe-40e3-9de9-41662bd19a24 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:49.623761 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23ff395e-10fe-40e3-9de9-41662bd19a24 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:49.637372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1127/2215] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:17:51.655004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:51.655530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:51.655741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:51.697094 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] MFA Rules not processed for user `a72798fe70b34ae48470f15fcbe666a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:51.698416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:51.734501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:17:51.787832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1089/2216] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:51.791948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5517-10a3-406c-af24-9bead939e556 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:51.792461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5517-10a3-406c-af24-9bead939e556 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:51.792572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aec5517-10a3-406c-af24-9bead939e556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:51.798716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:51.800173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:51.809392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9aec5517-10a3-406c-af24-9bead939e556 None None] MFA Rules not processed for user `de7b3f1c5f0741a58cca937405a821ed`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:51.810643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9aec5517-10a3-406c-af24-9bead939e556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:51.867021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1128/2217] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:51.872829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a67544b-a0e3-4645-baa5-07fe3aa80e8a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:51.877110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3eaec77-e991-434e-9fc6-c7bfc4631615 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:51.877762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaec77-e991-434e-9fc6-c7bfc4631615 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:51.878071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaec77-e991-434e-9fc6-c7bfc4631615 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:51.878357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3eaec77-e991-434e-9fc6-c7bfc4631615 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:51.887015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaec77-e991-434e-9fc6-c7bfc4631615 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:51.888443 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3eaec77-e991-434e-9fc6-c7bfc4631615 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:51.898354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1090/2218] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:17:51 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:17:53.706266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:53.706749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:53.706865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:53.728769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] MFA Rules not processed for user `a72798fe70b34ae48470f15fcbe666a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:53.730053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:53.737912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1129/2219] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:17:53 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:55.430496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:55.431358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:55.431648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:55.449492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:17:55.450720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:55.509013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1091/2220] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:17:55 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:17:55.521374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:17:55.522949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:17:55.604762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81fcc5b-deca-4175-ab9b-53217f22c213 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:17:55.609613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-862cae1b-05cc-4555-afb7-78810d054f15 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:17:55.610351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cae1b-05cc-4555-afb7-78810d054f15 service swift] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:17:55.610634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cae1b-05cc-4555-afb7-78810d054f15 service swift] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:17:55.610912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-862cae1b-05cc-4555-afb7-78810d054f15 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:17:55.620055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cae1b-05cc-4555-afb7-78810d054f15 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:17:55.621634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-862cae1b-05cc-4555-afb7-78810d054f15 service swift] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:17:55.631278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1130/2221] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:17:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 110 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:18:05.502336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=78 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:18:05.627918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:18:24.790217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:24.809118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7321c88-2a1c-493b-a28d-9a823e3e7e3c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:24.812803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:24.813458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:24.813738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:24.814017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:24.815995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:24.880001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:24.881457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:24.891732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1092/2222] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:24 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:34.886726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=34 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:18:38.310645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:38.311842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:38.311842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:38.346931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:38.348231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:38.363022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1131/2223] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:18:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:38.385517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:38.405422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc36667-4935-403e-8dc5-5fb85a1348b0 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:38.412876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814f84d6-9dfa-43df-8d08-e943f87fb3c6 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:38.413736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f84d6-9dfa-43df-8d08-e943f87fb3c6 service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:38.414153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f84d6-9dfa-43df-8d08-e943f87fb3c6 service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:38.414596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814f84d6-9dfa-43df-8d08-e943f87fb3c6 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:38.424814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f84d6-9dfa-43df-8d08-e943f87fb3c6 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:38.427509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814f84d6-9dfa-43df-8d08-e943f87fb3c6 service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:38.450996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1093/2224] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:18:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:18:40.973439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:40.977505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:41.218456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe90909-e42b-40ab-bce8-51722f34d48f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:41.232487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:41.234779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:41.236527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:41.237052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:41.250390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:41.273356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:41.278417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:41.312054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1132/2225] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:40 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 339 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:45.115722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8df85-8784-4418-a51e-4746bb4c6084 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:45.116630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8df85-8784-4418-a51e-4746bb4c6084 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:45.117649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d8df85-8784-4418-a51e-4746bb4c6084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:45.192665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-08d8df85-8784-4418-a51e-4746bb4c6084 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:45.194208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-08d8df85-8784-4418-a51e-4746bb4c6084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:45.227792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1094/2226] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:18:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:45.244810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:45.246371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:45.371907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fffb660-0302-460a-87d9-34a331820e67 service placement] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:45.378235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:45.378907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:45.379192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:45.379468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:45.389353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:45.391003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:45.402618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1133/2227] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 158 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:50.613529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ef01-4f46-4d1c-a0b0-0b5092e77d88 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:50.614633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ef01-4f46-4d1c-a0b0-0b5092e77d88 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:50.615075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4350ef01-4f46-4d1c-a0b0-0b5092e77d88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:50.635523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4350ef01-4f46-4d1c-a0b0-0b5092e77d88 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:50.636757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4350ef01-4f46-4d1c-a0b0-0b5092e77d88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:50.644630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1095/2228] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:18:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:50.660530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:50.671582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b55cefc-179c-4bec-9b9c-f2a16b561252 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:50.677361 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:50.678010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:50.678315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:50.678587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:50.687774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:50.689367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:50.694917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:18:50.702886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1134/2229] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:55.089089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85130f-a99b-4300-b4ab-039e32119c48 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:55.089592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85130f-a99b-4300-b4ab-039e32119c48 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:55.089779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a85130f-a99b-4300-b4ab-039e32119c48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:55.108811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9a85130f-a99b-4300-b4ab-039e32119c48 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:55.110134 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9a85130f-a99b-4300-b4ab-039e32119c48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:55.119446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1096/2230] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:18:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:55.133845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:55.135333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:55.150293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c1f8861-1512-4dad-9049-2f4f4e8f19a6 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:55.156573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:55.157320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:55.157675 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:55.158049 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:55.168474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:55.169882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:55.181089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1135/2231] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:59.002484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9304b-2009-4ae8-a149-a45ca2533fed None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.002989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9304b-2009-4ae8-a149-a45ca2533fed None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.003223 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20b9304b-2009-4ae8-a149-a45ca2533fed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.021212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-20b9304b-2009-4ae8-a149-a45ca2533fed None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:59.022447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-20b9304b-2009-4ae8-a149-a45ca2533fed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:59.030955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1097/2232] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:59.048748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:59.060635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8160d62-907c-433b-93f2-7fc6ee2efabf service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:59.066579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae66d08b-5cd5-4378-9ada-d8de75c0cf02 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:59.067230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d08b-5cd5-4378-9ada-d8de75c0cf02 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.068449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d08b-5cd5-4378-9ada-d8de75c0cf02 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.068449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae66d08b-5cd5-4378-9ada-d8de75c0cf02 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.076822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d08b-5cd5-4378-9ada-d8de75c0cf02 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:59.078470 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae66d08b-5cd5-4378-9ada-d8de75c0cf02 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:59.088453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1136/2233] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:59.274617 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b32efa-7527-4233-b3c7-a37e56e7e8a1 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.275012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b32efa-7527-4233-b3c7-a37e56e7e8a1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.275439 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b32efa-7527-4233-b3c7-a37e56e7e8a1 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.277251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1098/2234] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:18:59 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:18:59.286560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88fc5-8470-47ba-9d23-72da4db3e7ba None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.287105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88fc5-8470-47ba-9d23-72da4db3e7ba None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.287390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd88fc5-8470-47ba-9d23-72da4db3e7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.345036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-bbd88fc5-8470-47ba-9d23-72da4db3e7ba None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:59.346540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-bbd88fc5-8470-47ba-9d23-72da4db3e7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:59.356922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1137/2235] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 72 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:59.368896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b32efa-7527-4233-b3c7-a37e56e7e8a1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:59.371151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a3b32efa-7527-4233-b3c7-a37e56e7e8a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:59.452096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b32efa-7527-4233-b3c7-a37e56e7e8a1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:59.455635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b98b62b-8ba9-43de-8e7a-18a57d2b8f2a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:59.456272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b62b-8ba9-43de-8e7a-18a57d2b8f2a service glance] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.456551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b62b-8ba9-43de-8e7a-18a57d2b8f2a service glance] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.456829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b98b62b-8ba9-43de-8e7a-18a57d2b8f2a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.467559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b62b-8ba9-43de-8e7a-18a57d2b8f2a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:59.468991 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b98b62b-8ba9-43de-8e7a-18a57d2b8f2a service glance] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:59.480527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1099/2236] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:59.686649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f818-e3c3-47cb-823e-a17e00973e78 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.686959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f818-e3c3-47cb-823e-a17e00973e78 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.687276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdb2f818-e3c3-47cb-823e-a17e00973e78 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.688632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1138/2237] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:18:59.694278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574c27-c3ee-4e97-876a-b7a2282f201a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.694563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574c27-c3ee-4e97-876a-b7a2282f201a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.694850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57574c27-c3ee-4e97-876a-b7a2282f201a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.725459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-57574c27-c3ee-4e97-876a-b7a2282f201a None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:59.726710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-57574c27-c3ee-4e97-876a-b7a2282f201a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:59.734143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1100/2238] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:59.747488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f818-e3c3-47cb-823e-a17e00973e78 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:59.758600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdb2f818-e3c3-47cb-823e-a17e00973e78 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:59.763093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9942d1d8-36df-438b-af29-d1744ba131ab service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:59.764227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942d1d8-36df-438b-af29-d1744ba131ab service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.764227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942d1d8-36df-438b-af29-d1744ba131ab service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.764655 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9942d1d8-36df-438b-af29-d1744ba131ab service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.772767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942d1d8-36df-438b-af29-d1744ba131ab service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:59.774406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9942d1d8-36df-438b-af29-d1744ba131ab service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:59.783367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1139/2239] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:18:59.867912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecaaeb-ca8a-4a8c-b08d-e9d95840f0b9 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.868233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecaaeb-ca8a-4a8c-b08d-e9d95840f0b9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.868486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35ecaaeb-ca8a-4a8c-b08d-e9d95840f0b9 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.869903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1101/2240] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:18:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:18:59.876094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1853-97ff-4530-9591-75d9b88df7d2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.876392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1853-97ff-4530-9591-75d9b88df7d2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.876676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b2c1853-97ff-4530-9591-75d9b88df7d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.896132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5b2c1853-97ff-4530-9591-75d9b88df7d2 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:18:59.897394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5b2c1853-97ff-4530-9591-75d9b88df7d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:59.912794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1140/2241] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:18:59 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:18:59.931413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecaaeb-ca8a-4a8c-b08d-e9d95840f0b9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:18:59.933192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-35ecaaeb-ca8a-4a8c-b08d-e9d95840f0b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:18:59.947908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35ecaaeb-ca8a-4a8c-b08d-e9d95840f0b9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:18:59.951808 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7a42-afa8-4677-801e-f1b1b038ac4e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:18:59.952455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7a42-afa8-4677-801e-f1b1b038ac4e service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:18:59.952769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7a42-afa8-4677-801e-f1b1b038ac4e service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:18:59.953052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7a42-afa8-4677-801e-f1b1b038ac4e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:18:59.965381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7a42-afa8-4677-801e-f1b1b038ac4e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:18:59.966868 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7a42-afa8-4677-801e-f1b1b038ac4e service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:18:59.977923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1102/2242] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:18:59 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:19:02.035817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:02.036309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:02.036565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:02.054216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] MFA Rules not processed for user `9d3ca58b09634edc9e093d9d9eb0ee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:02.055427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:02.127341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1141/2243] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:19:02 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:19:02.269214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c054eb-f647-46fa-aa19-0850ba1ce730 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:02.269727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c054eb-f647-46fa-aa19-0850ba1ce730 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:02.269845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c054eb-f647-46fa-aa19-0850ba1ce730 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:02.289837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-26c054eb-f647-46fa-aa19-0850ba1ce730 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:02.291161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-26c054eb-f647-46fa-aa19-0850ba1ce730 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:02.299980 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1103/2244] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:19:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:02.314194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:19:02.329039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3960b077-62b2-4b90-8eb0-f10b2c01fdc1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:19:02.335050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:19:02.335746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:02.336278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:02.336627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:02.346449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:19:02.348150 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:19:02.358813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1142/2245] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:19:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:19:05.358312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078bc52-e91f-4656-b4d0-976f89fa9732 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:05.358795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078bc52-e91f-4656-b4d0-976f89fa9732 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:05.358887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9078bc52-e91f-4656-b4d0-976f89fa9732 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:05.364056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:05.408160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9078bc52-e91f-4656-b4d0-976f89fa9732 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:05.409325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9078bc52-e91f-4656-b4d0-976f89fa9732 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:05.427881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1104/2246] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:19:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:05.440289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:19:05.467372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5fd5dbc-1dea-44e4-a62c-22fc6fe5ca6b service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:19:05.473831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:19:05.474546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:05.475005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:05.475289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:05.485268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:19:05.486909 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:19:05.495642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1143/2247] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:19:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:19:06.554437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9902c-186d-43a5-bec3-6f6bccf63de5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:06.555288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9902c-186d-43a5-bec3-6f6bccf63de5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:06.555800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb9902c-186d-43a5-bec3-6f6bccf63de5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:06.577499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2bb9902c-186d-43a5-bec3-6f6bccf63de5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:06.578832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2bb9902c-186d-43a5-bec3-6f6bccf63de5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:06.588366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1105/2248] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:19:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:06.611729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:19:06.628180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8098bdeb-b8d0-4182-b1fa-c30ec368378e service swift] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:19:06.634730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:19:06.635378 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:06.635702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:06.636013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:06.646590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:19:06.648182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:19:06.657920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1144/2249] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:19:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:19:16.571705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=20 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:16.653631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=77 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:24.240530 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1e25-b9e1-4c30-9749-c90873c72ee4 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:24.241011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1e25-b9e1-4c30-9749-c90873c72ee4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:24.241101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021f1e25-b9e1-4c30-9749-c90873c72ee4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:24.259968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-021f1e25-b9e1-4c30-9749-c90873c72ee4 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:24.261872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-021f1e25-b9e1-4c30-9749-c90873c72ee4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:24.269067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1106/2250] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 6 17:19:24 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:24.281497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:19:24.293137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d85de5a-95b6-41c9-ac47-9e43d987b465 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:19:24.298144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e08c964-7ad8-48e9-98c6-457108994b1a service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:19:24.298778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c964-7ad8-48e9-98c6-457108994b1a service swift] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:24.299063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c964-7ad8-48e9-98c6-457108994b1a service swift] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:24.314210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e08c964-7ad8-48e9-98c6-457108994b1a service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:24.314210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08c964-7ad8-48e9-98c6-457108994b1a service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:19:24.314210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e08c964-7ad8-48e9-98c6-457108994b1a service swift] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:19:24.322235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1145/2251] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:19:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:19:34.254471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:34.318457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=6 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:37.477709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4dd71-d391-4f2b-a7bb-24fe948cf525 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:37.478259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4dd71-d391-4f2b-a7bb-24fe948cf525 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:37.478259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbf4dd71-d391-4f2b-a7bb-24fe948cf525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:37.496677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-dbf4dd71-d391-4f2b-a7bb-24fe948cf525 None None] MFA Rules not processed for user `a72798fe70b34ae48470f15fcbe666a6`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:37.497855 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-dbf4dd71-d391-4f2b-a7bb-24fe948cf525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:37.504898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1107/2252] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:19:37 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:43.114463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee176b0-8ecc-477a-ad08-27b07b0e9615 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:43.116649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee176b0-8ecc-477a-ad08-27b07b0e9615 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:43.116649 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee176b0-8ecc-477a-ad08-27b07b0e9615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:43.133057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6ee176b0-8ecc-477a-ad08-27b07b0e9615 None None] MFA Rules not processed for user `c4815e3cdfc9485f8c8b0f1d0a0cc0cd`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:43.134362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6ee176b0-8ecc-477a-ad08-27b07b0e9615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:43.187162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1146/2253] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:19:43 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:47.491104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:53.138842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:53.139449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:53.139449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:53.157361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] MFA Rules not processed for user `63116783cc3f4f84a11027d5bfdab705`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:53.158601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:53.180163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=25 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:19:53.215300 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1108/2254] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:19:53 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:59.683214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a9df-c1d7-438f-8a35-e786cc1101a1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:59.683709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a9df-c1d7-438f-8a35-e786cc1101a1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:59.683859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1a9a9df-c1d7-438f-8a35-e786cc1101a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:59.703316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b1a9a9df-c1d7-438f-8a35-e786cc1101a1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:19:59.704507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b1a9a9df-c1d7-438f-8a35-e786cc1101a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:19:59.712280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1147/2255] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:19:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:19:59.744421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:19:59.757771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-585ac780-a4cd-4b29-9bf9-1b360f5a576f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:19:59.763356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:19:59.763986 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:19:59.764267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:19:59.764544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:19:59.772672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:19:59.774287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:19:59.783543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1109/2256] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:19:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:04.248170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95e74-6d61-4f9f-a239-75afdb2cacac None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:04.248774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95e74-6d61-4f9f-a239-75afdb2cacac None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:04.248875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e95e74-6d61-4f9f-a239-75afdb2cacac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:04.268927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-34e95e74-6d61-4f9f-a239-75afdb2cacac None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:04.276911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-34e95e74-6d61-4f9f-a239-75afdb2cacac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:04.279192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1148/2257] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:20:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:04.297838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:04.308618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ff95960-3ffc-4cf1-8c8d-d5757c7173cc service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:04.315448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:04.316394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:04.316863 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:04.317140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:04.326211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:04.329231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:04.338797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1110/2258] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:08.101935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360afad4-0bee-4be8-b80f-dea51e9b6fa0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:08.102497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360afad4-0bee-4be8-b80f-dea51e9b6fa0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:08.102497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-360afad4-0bee-4be8-b80f-dea51e9b6fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:08.122684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-360afad4-0bee-4be8-b80f-dea51e9b6fa0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:08.124021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-360afad4-0bee-4be8-b80f-dea51e9b6fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:08.132379 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1149/2259] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:20:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:08.151184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:08.163898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-202e125a-125d-42f1-9608-a17edfb6990f service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:08.171539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:08.172202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:08.172492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:08.172773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:08.181908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:08.183536 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:08.193810 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1111/2260] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:12.365535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce9d3-aad3-4304-b1d4-f89c23f0a8e4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:12.366052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce9d3-aad3-4304-b1d4-f89c23f0a8e4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:12.366147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1ce9d3-aad3-4304-b1d4-f89c23f0a8e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:12.384570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ca1ce9d3-aad3-4304-b1d4-f89c23f0a8e4 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:12.385748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ca1ce9d3-aad3-4304-b1d4-f89c23f0a8e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:12.393469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1150/2261] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:20:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:12.416557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:12.428230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049217bb-6236-47c3-a97b-858f2963f6dc service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:12.433654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:12.434312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:12.434597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:12.434880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:12.443484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:12.445055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:12.454517 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1112/2262] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:17.709045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d94e-87bc-47cd-9c96-33d9a66f7982 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:17.709530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d94e-87bc-47cd-9c96-33d9a66f7982 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:17.709633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a59d94e-87bc-47cd-9c96-33d9a66f7982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:17.727383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1a59d94e-87bc-47cd-9c96-33d9a66f7982 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:17.728578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1a59d94e-87bc-47cd-9c96-33d9a66f7982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:17.737910 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1151/2263] 10.222.0.43 () {58 vars in 1016 bytes} [Wed Jul 6 17:20:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:17.759656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:17.766160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=50 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:17.778520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80b18edb-67b3-482e-b5f9-cdb8e40da41c service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:17.778520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:17.779688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:17.779688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:17.779688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:17.788441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:17.790091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:17.800317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1113/2264] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:19.533626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:19.534223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:19.534223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:19.552672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] MFA Rules not processed for user `5aa93da151774e5eaa092cdc5d445dba`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:19.553603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:19.607651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1152/2265] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:19 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:27.856871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:29.602431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=40 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:33.015251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:33.030757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5df2c133-4001-45fc-8f9c-c346dc6a08ef service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:33.032778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:33.033509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:33.033867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:33.034254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:33.036526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:33.051869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:33.053918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0f6e20-586b-4362-8040-d2b94be9a496 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:33.067395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1114/2266] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:33 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:34.261452 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:34.271635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f90839-3115-4bf3-9f43-092da30607ab None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:34.275350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:34.275984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:34.276268 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:34.276553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:34.278339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:34.292118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:34.293533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2b3fed2-d175-41ed-95f1-762618c070df service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:34.304425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1153/2267] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:34 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:43.060802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=6 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:44.299625 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=6 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:44.507977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:44.508467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:44.508565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:44.526964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] MFA Rules not processed for user `9d3ca58b09634edc9e093d9d9eb0ee3f`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:44.528264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:44.536997 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1115/2268] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:44 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:46.635714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:46.636187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:46.636454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:46.655373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:46.657266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:46.665193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1154/2269] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 6 17:20:46 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:20:46.797031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:46.810628 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813069e-c334-4ab9-9e71-d99a428b0a3c None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:46.816017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:46.816762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:46.817155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:46.817523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:46.828189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:46.830464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:46.849594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1116/2270] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:20:46 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:20:49.058115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:49.059610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:49.093982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e94a4c4-43fc-4ec8-b94e-b743ed04692e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:49.097983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:49.098762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:49.099031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:49.099310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:49.101186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:49.113654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:49.115215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ee98c6f-d02a-49fa-8d20-5563734fdec3 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:49.128812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1155/2271] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:49 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 70 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:50.847913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:50.870197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13103302-1c66-4bef-b548-b972820dd376 service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:50.883999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:50.887406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:50.887406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:50.887406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:50.890435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:50.905063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:50.907499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc1bad7-c638-4023-aec2-9ad0dec67acf service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:50.918839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1117/2272] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:50 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:52.175243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8db7e-086e-43fd-9f29-372a7a9a0e98 None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:52.175738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8db7e-086e-43fd-9f29-372a7a9a0e98 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:52.178203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a8db7e-086e-43fd-9f29-372a7a9a0e98 None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:52.179931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1156/2273] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:20:52 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:20:52.191436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:52.191900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:52.191998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:52.244683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] MFA Rules not processed for user `6aac6f87525e413c8c99e1c6edddf591`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:52.246661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:52.258219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1118/2274] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:20:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 68 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:52.276375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8db7e-086e-43fd-9f29-372a7a9a0e98 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:52.290260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a8db7e-086e-43fd-9f29-372a7a9a0e98 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:52.295582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:52.296220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:52.296502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:52.296778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:52.306787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:52.308367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:52.320434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:52.323069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1157/2275] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:52 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:52.335542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd8d0f74-0085-4c54-8d19-8eea143efcc5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:52.342111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:52.343008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:52.343259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:52.343558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] PATH_INFO: `/v3/users/a72798fe70b34ae48470f15fcbe666a6` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:52.345427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] RBAC: Authorizing `identity:delete_user(user_id=a72798fe70b34ae48470f15fcbe666a6)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:52.347475 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:52.536346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a72798fe70b34ae48470f15fcbe666a6'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:52.552862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a72798fe70b34ae48470f15fcbe666a6'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:52.572949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a72798fe70b34ae48470f15fcbe666a6'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:52.573731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a72798fe70b34ae48470f15fcbe666a6'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:52.644560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a72798fe70b34ae48470f15fcbe666a6'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:52.651539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1119/2276] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:20:52 2022] DELETE /identity/v3/users/a72798fe70b34ae48470f15fcbe666a6 => generated 0 bytes in 332 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:53.015139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.033424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa6fa44-fb9d-4c2a-884c-548b97b1f957 service placement] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.107794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.109059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.109353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.109640 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] PATH_INFO: `/v3/projects/a9bf0eaeadc845889b942782a3a9663b` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.112874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a9bf0eaeadc845889b942782a3a9663b)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.115586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.186592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.188529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:53.251664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a9bf0eaeadc845889b942782a3a9663b', 'request_id': 'req-88e82cb2-052e-44ee-8b72-a6738f2df984'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:53.264724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a9bf0eaeadc845889b942782a3a9663b', 'request_id': 'req-88e82cb2-052e-44ee-8b72-a6738f2df984'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:53.272767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a9bf0eaeadc845889b942782a3a9663b', 'request_id': 'req-88e82cb2-052e-44ee-8b72-a6738f2df984'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:53.309663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f0d7fe2-e963-4b36-8df3-e81421d2726e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.326881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:53.349547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] The token cache is being invalidate because project a9bf0eaeadc845889b942782a3a9663b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:20:53.349905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:53.350722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-88e82cb2-052e-44ee-8b72-a6738f2df984 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:53.356645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1158/2277] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:20:53 2022] DELETE /identity/v3/projects/a9bf0eaeadc845889b942782a3a9663b => generated 0 bytes in 339 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:53.358754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c98e-071b-42e7-9a99-e1bee2695ce2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.359479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c98e-071b-42e7-9a99-e1bee2695ce2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.360374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1a5c98e-071b-42e7-9a99-e1bee2695ce2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.384296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e1a5c98e-071b-42e7-9a99-e1bee2695ce2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:53.385749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e1a5c98e-071b-42e7-9a99-e1bee2695ce2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:53.402713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.403420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.403705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.403983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.406133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:53.435187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:53.471581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1159/2278] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:53.479259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.479545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.479819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.481785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.483561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.501329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1120/2279] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:53 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 315 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:20:53.511787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:53.513010 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:53.525182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1160/2280] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:20:53.529354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.541060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41721a05-b533-420c-bbec-decba0ee9fd8 service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.554908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.557594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.557881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.558202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.558952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:20:53.559264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.561359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.579601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1121/2281] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:20:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:20:53.580953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.591676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d3094b3-a138-46fc-af04-4b5ba308ee68 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.597519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.598264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.598791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.599376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.600259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.602492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.706226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1161/2282] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:20:53 2022] POST /identity/v3/projects => generated 385 bytes in 122 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:20:53.707410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.722319 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a484a364-582d-4775-bb2d-4bb36a90ed1e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.783726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.784525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.784815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.785098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.785788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.787761 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.859677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1122/2283] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:20:53 2022] POST /identity/v3/users => generated 293 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:20:53.864196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.874550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71e12eff-1921-4f0e-a1b6-f6e2959aff5e admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.879888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.880538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.880819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.886162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.886162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.886162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.894722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1162/2284] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:20:53.898688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.908840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68f66eee-07df-4f1d-87db-0b5209a50a81 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.920912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d969e73-c54b-49a3-89e2-e59b620e7446 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.920912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969e73-c54b-49a3-89e2-e59b620e7446 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.920912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969e73-c54b-49a3-89e2-e59b620e7446 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.920912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d969e73-c54b-49a3-89e2-e59b620e7446 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.921272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d969e73-c54b-49a3-89e2-e59b620e7446 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.921272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d969e73-c54b-49a3-89e2-e59b620e7446 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:53.930082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1123/2285] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:20:53 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:20:53.931658 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:53.943354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f242553c-f534-4282-9601-27ea0114cbe3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:53.948202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:53.949236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:53.949517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:53.955170 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] PATH_INFO: `/v3/projects/95c24e26c3e34e62b31cd94173cabc19/users/3079b9961e7d488fa4a223a1a9f83e48/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:53.968636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95c24e26c3e34e62b31cd94173cabc19, user_id=3079b9961e7d488fa4a223a1a9f83e48, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:53.972254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:54.101605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1163/2286] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:20:53 2022] PUT /identity/v3/projects/95c24e26c3e34e62b31cd94173cabc19/users/3079b9961e7d488fa4a223a1a9f83e48/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:54.111794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:54.112087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:54.112365 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:54.140709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] MFA Rules not processed for user `3079b9961e7d488fa4a223a1a9f83e48`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:54.142687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:54.212017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1124/2287] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:54.213752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:54.224390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:54.226265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:54.297708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a100c2-7abe-4e64-bae7-16a8816674b6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:54.302142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:54.305650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:54.305650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:54.305650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:54.315645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:54.324006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:54.335336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1164/2288] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:20:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:20:57.764145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:57.765654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:57.838564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3587bc-8f79-46b5-a56a-78c763e3362a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:57.843021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:57.843886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:57.844746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:57.845022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] PATH_INFO: `/v3/users/de7b3f1c5f0741a58cca937405a821ed` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:57.846580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] RBAC: Authorizing `identity:delete_user(user_id=de7b3f1c5f0741a58cca937405a821ed)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:57.848598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:58.098156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'de7b3f1c5f0741a58cca937405a821ed'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.105087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'de7b3f1c5f0741a58cca937405a821ed'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.117122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'de7b3f1c5f0741a58cca937405a821ed'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.117783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'de7b3f1c5f0741a58cca937405a821ed'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.207326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'de7b3f1c5f0741a58cca937405a821ed'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.213647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1125/2289] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:20:57 2022] DELETE /identity/v3/users/de7b3f1c5f0741a58cca937405a821ed => generated 0 bytes in 451 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:58.470258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:58.483311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f33ba443-deb1-4714-983c-b18c19dcddcb service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:58.589270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:58.590457 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:58.590737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:58.591012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] PATH_INFO: `/v3/projects/1876774ff79e4a0da6706b9d521a3731` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:58.593101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=1876774ff79e4a0da6706b9d521a3731)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:58.595148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:58.641829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:58.731514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1876774ff79e4a0da6706b9d521a3731', 'request_id': 'req-d2a39aa2-875d-4187-b3b1-385ac21728fc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.737303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1876774ff79e4a0da6706b9d521a3731', 'request_id': 'req-d2a39aa2-875d-4187-b3b1-385ac21728fc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.744115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1876774ff79e4a0da6706b9d521a3731', 'request_id': 'req-d2a39aa2-875d-4187-b3b1-385ac21728fc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.830337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] The token cache is being invalidate because project 1876774ff79e4a0da6706b9d521a3731 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:20:58.830636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.831318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:58.832961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1165/2290] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:20:58 2022] DELETE /identity/v3/projects/1876774ff79e4a0da6706b9d521a3731 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:58.836989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:58.838524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:58.852787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eaee05d-be9d-4fb5-a6fb-17225f5356ba admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:58.891557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:20:58.924676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:58.925825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:58.926141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:58.926421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] PATH_INFO: `/v3/users/735ed165da76433eba0116c15d354181` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:58.927646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] RBAC: Authorizing `identity:delete_user(user_id=735ed165da76433eba0116c15d354181)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:58.929721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:59.121329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '735ed165da76433eba0116c15d354181'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.128791 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '735ed165da76433eba0116c15d354181'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.140535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '735ed165da76433eba0116c15d354181'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.141777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '735ed165da76433eba0116c15d354181'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.230337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0e028ead-1a19-48ac-8666-a869886ac75e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '735ed165da76433eba0116c15d354181'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.240747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1126/2291] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:20:58 2022] DELETE /identity/v3/users/735ed165da76433eba0116c15d354181 => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:59.485969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:59.487463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:59.501186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2a39aa2-875d-4187-b3b1-385ac21728fc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:59.570376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:59.572279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:59.573252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:59.573600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] PATH_INFO: `/v3/projects/8e50a26260624e71b71a8891d63e322a` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:59.575301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8e50a26260624e71b71a8891d63e322a)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:59.577200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:59.714618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8e50a26260624e71b71a8891d63e322a', 'request_id': 'req-db818948-a58a-4a29-a41e-5fa9a38285a0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.725213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8e50a26260624e71b71a8891d63e322a', 'request_id': 'req-db818948-a58a-4a29-a41e-5fa9a38285a0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.731982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8e50a26260624e71b71a8891d63e322a', 'request_id': 'req-db818948-a58a-4a29-a41e-5fa9a38285a0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.811841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] The token cache is being invalidate because project 8e50a26260624e71b71a8891d63e322a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:20:59.814271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.814271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-db818948-a58a-4a29-a41e-5fa9a38285a0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:20:59.816291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1166/2292] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:20:59 2022] DELETE /identity/v3/projects/8e50a26260624e71b71a8891d63e322a => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:20:59.821194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:59.822342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:59.822778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:59.845112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:59.846409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:59.908174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1127/2293] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:59.915985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:59.916335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:59.916650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:59.935525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:20:59.936837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:20:59.945298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1167/2294] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:20:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:20:59.949556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:20:59.966469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5acd658e-b8c7-427a-a654-2897739d065a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:20:59.972900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:20:59.972900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:20:59.972900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:20:59.972900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:20:59.973729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:20:59.974061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:20:59.977193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:20:59.988791 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1128/2295] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:20:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:20:59.993025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:00.003455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f69605-dea9-4ffb-8fc6-05c69fdedce1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:00.008630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:00.009312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.009613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.009866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.010615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:00.013422 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:00.134064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1168/2296] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:20:59 2022] POST /identity/v3/projects => generated 373 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:00.135688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:00.147132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe535680-15d8-406a-8fe4-f61e230efa0e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:00.218998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:00.218998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.218998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.218998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.219391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:00.221568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:00.307389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1129/2297] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:00 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:00.311326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:00.323604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbb1e653-21b9-463d-a5cf-29e4e9a10c40 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:00.328782 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:00.329525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.329900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.330294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.331103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:00.332874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:00.337204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:00.345229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1169/2298] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:00.349260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:00.362496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db74de-b3d2-4918-b308-1273d7c13525 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:00.367248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce92ca86-8401-4398-82a5-76c6e8357133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:00.368058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92ca86-8401-4398-82a5-76c6e8357133 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.368398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92ca86-8401-4398-82a5-76c6e8357133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.368629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce92ca86-8401-4398-82a5-76c6e8357133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.369362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92ca86-8401-4398-82a5-76c6e8357133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:00.371076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce92ca86-8401-4398-82a5-76c6e8357133 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:00.382486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1130/2299] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:00.386812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:00.416839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296d3926-e8ca-4f9d-b6ad-2c7835f83214 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:00.423214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:00.423419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.423522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.423806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] PATH_INFO: `/v3/projects/1befb3820db34c1f8271b48b767401ae/users/859a278562b24044910f65508d7c30aa/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.439413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=1befb3820db34c1f8271b48b767401ae, user_id=859a278562b24044910f65508d7c30aa, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:00.442251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:00.518505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1170/2300] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:00 2022] PUT /identity/v3/projects/1befb3820db34c1f8271b48b767401ae/users/859a278562b24044910f65508d7c30aa/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 132 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:00.523838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.524133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.524417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.546188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:00.547463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:00.588171 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:00.615545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1131/2301] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:00.625749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:00.627574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:00.685149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a5dd153-06bb-4b6d-bb7f-25d0c3df2b56 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:00.689576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:00.690241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:00.690536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:00.690799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:00.700084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:00.701515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:00.711585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1171/2302] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:01.793925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:01.804373 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579eced7-aeee-4326-bb0b-e7d1ab6d7329 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:01.808186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:01.809086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:01.809398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:01.809664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:01.811577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:01.822656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:01.824398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:01.833429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1132/2303] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:01 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:05.163281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:05.165163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:05.177925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e962f15c-e0fd-48ed-a6e6-a3fca61fb387 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:05.182820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:05.183691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:05.184125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:05.186437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:05.187126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:05.204246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:05.205770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd7e1d5d-b3fe-4f76-ac6f-572fcc9ea101 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:05.216017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1172/2304] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:06.438247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:06.439835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:06.481454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036eb93e-9f50-4b05-8d76-8ef8e6b9aa68 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:06.490783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:06.491683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:06.491970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:06.492253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] PATH_INFO: `/v3/users/3079b9961e7d488fa4a223a1a9f83e48` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:06.493593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] RBAC: Authorizing `identity:delete_user(user_id=3079b9961e7d488fa4a223a1a9f83e48)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:06.495956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:06.722139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:06.722639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:06.722818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:06.763173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] MFA Rules not processed for user `859a278562b24044910f65508d7c30aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:06.765671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:06.842998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3079b9961e7d488fa4a223a1a9f83e48'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:06.854022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3079b9961e7d488fa4a223a1a9f83e48'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:06.872203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1173/2305] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:06.873845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:06.890270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ffa606-7e30-4375-b0d8-1881b9e88682 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:06.904964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fffdd9e5-b67d-433e-9237-0816615afbdf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:06.904964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdd9e5-b67d-433e-9237-0816615afbdf admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:06.904964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdd9e5-b67d-433e-9237-0816615afbdf admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:06.904964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fffdd9e5-b67d-433e-9237-0816615afbdf admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:06.905415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdd9e5-b67d-433e-9237-0816615afbdf admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:06.909058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fffdd9e5-b67d-433e-9237-0816615afbdf admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:06.924577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3079b9961e7d488fa4a223a1a9f83e48'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:06.927927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3079b9961e7d488fa4a223a1a9f83e48'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:07.012046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3079b9961e7d488fa4a223a1a9f83e48'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:07.034626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1133/2306] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:06 2022] DELETE /identity/v3/users/3079b9961e7d488fa4a223a1a9f83e48 => generated 0 bytes in 594 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:07.034626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:07.034949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1174/2307] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:06 2022] POST /identity/v3/projects => generated 371 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:07.036458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.036747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.037023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.038159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:07.061507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:07.063759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:07.065266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:07.095537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:07.134470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1d161b6-8dca-47db-94af-92939e08bc6f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:07.139677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:07.140594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.140908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.141185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.141898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:07.144590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:07.149090 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1175/2308] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:07.153908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:07.155646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:07.215426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef889d36-a1e8-4f70-a8fb-5b1743b90185 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:07.221147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:07.221808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.222133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.222415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.232956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:07.237061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:07.238386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1134/2309] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:07 2022] POST /identity/v3/users => generated 292 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:07.239885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:07.247312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1176/2310] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:07.252516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4c6250c-cde4-445f-9478-b18f72c396f5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:07.258196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:07.258878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.259294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.259611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.260460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:07.262096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:07.273485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1135/2311] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:07.279404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:07.290859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f6d426-5ab1-48bc-96ce-0e169db09395 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:07.297153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:07.298201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.298558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.298904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] PATH_INFO: `/v3/projects/e1c448c1d1d74749a0de49ee7e7c0b0a/users/0cdcf5b8d45e45a9bd027a48efe992f2/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.314969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c448c1d1d74749a0de49ee7e7c0b0a, user_id=0cdcf5b8d45e45a9bd027a48efe992f2, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:07.318434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:07.387240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1177/2312] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:07 2022] PUT /identity/v3/projects/e1c448c1d1d74749a0de49ee7e7c0b0a/users/0cdcf5b8d45e45a9bd027a48efe992f2/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:07.387933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:07.405549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-252e384a-6fba-4077-b748-add058f14f5e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:07.492186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:07.493388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.493616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.493891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.494671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:07.496698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:07.512321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1136/2313] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:07 2022] GET /identity/v3/roles => generated 1420 bytes in 126 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:07.517005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:07.529317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13210f0c-6d1a-4883-8821-68fbeb9bc03b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:07.539997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:07.545067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:07.545067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:07.545067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] PATH_INFO: `/v3/projects/e1c448c1d1d74749a0de49ee7e7c0b0a/users/0cdcf5b8d45e45a9bd027a48efe992f2/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:07.545067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] RBAC: Authorizing `identity:create_grant(project_id=e1c448c1d1d74749a0de49ee7e7c0b0a, user_id=0cdcf5b8d45e45a9bd027a48efe992f2, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:07.547262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:07.560052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1178/2314] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:07 2022] PUT /identity/v3/projects/e1c448c1d1d74749a0de49ee7e7c0b0a/users/0cdcf5b8d45e45a9bd027a48efe992f2/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:08.180847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:08.183378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:08.222386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69048898-a504-4fdf-b67e-45e021e55cec admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:08.357022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:08.358513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:08.359757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:08.360165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] PATH_INFO: `/v3/projects/95c24e26c3e34e62b31cd94173cabc19` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:08.361741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] RBAC: Authorizing `identity:delete_project(project_id=95c24e26c3e34e62b31cd94173cabc19)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:08.365141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:08.465820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=3,keystone:DELETE=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:08.491390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95c24e26c3e34e62b31cd94173cabc19', 'request_id': 'req-51209635-c150-4cda-89d0-6ef08c1a057c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:08.498645 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95c24e26c3e34e62b31cd94173cabc19', 'request_id': 'req-51209635-c150-4cda-89d0-6ef08c1a057c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:08.510250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95c24e26c3e34e62b31cd94173cabc19', 'request_id': 'req-51209635-c150-4cda-89d0-6ef08c1a057c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:08.583001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] The token cache is being invalidate because project 95c24e26c3e34e62b31cd94173cabc19 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:08.583487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:08.584845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:08.588063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1137/2315] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:08 2022] DELETE /identity/v3/projects/95c24e26c3e34e62b31cd94173cabc19 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:10.743418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:10.746624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:10.798766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df8c46c4-8d26-47f4-a969-f94f915fedec admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:10.917447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:10.918456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:10.918737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:10.919439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] PATH_INFO: `/v3/users/c4815e3cdfc9485f8c8b0f1d0a0cc0cd` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:10.920907 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4815e3cdfc9485f8c8b0f1d0a0cc0cd)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:10.923654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:11.220328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:INSERT=2,keystone:DELETE=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:11.239360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4815e3cdfc9485f8c8b0f1d0a0cc0cd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.263360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4815e3cdfc9485f8c8b0f1d0a0cc0cd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.272914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4815e3cdfc9485f8c8b0f1d0a0cc0cd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.273485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4815e3cdfc9485f8c8b0f1d0a0cc0cd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.381011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3e3f76f8-f3d1-483b-b2c6-a43499b65d4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4815e3cdfc9485f8c8b0f1d0a0cc0cd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.392323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1179/2316] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:10 2022] DELETE /identity/v3/users/c4815e3cdfc9485f8c8b0f1d0a0cc0cd => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:11.646948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:11.660141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51209635-c150-4cda-89d0-6ef08c1a057c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:11.730110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:11.739335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:11.739335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:11.739335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] PATH_INFO: `/v3/projects/abddabc35a004d6c82d0400aef1d6dac` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:11.739335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] RBAC: Authorizing `identity:delete_project(project_id=abddabc35a004d6c82d0400aef1d6dac)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:11.739335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:11.866949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'abddabc35a004d6c82d0400aef1d6dac', 'request_id': 'req-0069ff6d-e8da-407e-8be7-17a73322b051'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.876058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'abddabc35a004d6c82d0400aef1d6dac', 'request_id': 'req-0069ff6d-e8da-407e-8be7-17a73322b051'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.884259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'abddabc35a004d6c82d0400aef1d6dac', 'request_id': 'req-0069ff6d-e8da-407e-8be7-17a73322b051'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.974170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] The token cache is being invalidate because project abddabc35a004d6c82d0400aef1d6dac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:11.974595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.975355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0069ff6d-e8da-407e-8be7-17a73322b051 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:11.976931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1138/2317] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:11 2022] DELETE /identity/v3/projects/abddabc35a004d6c82d0400aef1d6dac => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:11.982433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:11.982991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:11.982991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.004174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:12.005032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:12.072449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1180/2318] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:12.080774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.081069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.081354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.102737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:12.104043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:12.113268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1139/2319] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:12.117664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.128410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ca0709-b469-49e9-8a2f-ef1baf2c3d1b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.133419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.134133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.134424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.134707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.135450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:12.135760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.137425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:12.150455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1181/2320] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:12.154803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.165553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3096317c-a03d-4837-9a2e-66b84666a026 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.170713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.171465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.172633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.172757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.173505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.175571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:12.249235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1140/2321] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:12 2022] POST /identity/v3/projects => generated 399 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:12.253971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.267764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef52252-8db8-4679-95ff-f802743f7de5 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.338568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.338568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.338568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.338885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.339521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.341683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:12.462572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1182/2322] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:12 2022] POST /identity/v3/users => generated 300 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:12.463531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.475884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c35a7c6-35e3-40b8-b43f-bfd0572d2014 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.487243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.487243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.487243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.487243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.487555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.487555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:12.499525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1141/2323] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:12.503753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.524935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36e387bc-d5dc-4276-a90c-cc3090e41bfe admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.539077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d01bbadf-1a0c-48bd-9f43-eeabc69a546d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.540345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bbadf-1a0c-48bd-9f43-eeabc69a546d admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.540931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bbadf-1a0c-48bd-9f43-eeabc69a546d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.541219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d01bbadf-1a0c-48bd-9f43-eeabc69a546d admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.541980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bbadf-1a0c-48bd-9f43-eeabc69a546d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.543958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d01bbadf-1a0c-48bd-9f43-eeabc69a546d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:12.563205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1183/2324] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:12 2022] GET /identity/v3/roles => generated 1420 bytes in 59 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:12.566912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.579938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77e17b81-a93b-4484-9c04-aae3e461a2a2 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.584639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.585518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.585797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.586116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] PATH_INFO: `/v3/projects/f765591df09b4f27abca0067209808bf/users/0455a734687940cbbc0b2c94ef51e787/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.589906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:12.603332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f765591df09b4f27abca0067209808bf, user_id=0455a734687940cbbc0b2c94ef51e787, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.606416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:12.683217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1142/2325] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:12 2022] PUT /identity/v3/projects/f765591df09b4f27abca0067209808bf/users/0455a734687940cbbc0b2c94ef51e787/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:12.695631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.695631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.695872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.736593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] MFA Rules not processed for user `0455a734687940cbbc0b2c94ef51e787`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:12.738164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:12.755824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=5,keystone:SELECT=91,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:12.820897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1184/2326] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:12 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:12.825163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:12.895344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10a2dde-75d4-44af-ae6a-6a280a422773 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:12.901268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:12.902323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:12.902713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:12.903097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:12.903948 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:12.907752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:13.033241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1143/2327] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:12 2022] POST /identity/v3/projects => generated 403 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:13.037867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:13.056145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-536156c7-0763-4b65-a3aa-7e7c29cd8d04 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:13.159265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:13.160059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:13.160483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:13.160939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:13.162103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:13.165594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:13.274536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1185/2328] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:13 2022] POST /identity/v3/users => generated 308 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:13.278803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:13.292984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4bfa834-2549-48d5-81b0-3f5c43dc4d90 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:13.303843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:13.307525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:13.307525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:13.307525 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:13.308608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:13.312461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:13.332828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1144/2329] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:13.337416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:13.353225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ede852-52c4-4153-b99a-dfdec67256a6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:13.360505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:13.361569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:13.361953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:13.362486 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] PATH_INFO: `/v3/projects/f2d7a712d21d458da73bba01a2aefe84/users/47a7461e23af48af9de1b10f57077abc/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:13.385709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d7a712d21d458da73bba01a2aefe84, user_id=47a7461e23af48af9de1b10f57077abc, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:13.390183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:13.516124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1186/2330] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:13 2022] PUT /identity/v3/projects/f2d7a712d21d458da73bba01a2aefe84/users/47a7461e23af48af9de1b10f57077abc/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 179 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:13.519781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:13.538735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85db36ef-ae7a-473f-bb92-086609b034aa admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:13.614582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4cd8e0-908e-4324-ac78-c33ac869c013 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:13.615552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cd8e0-908e-4324-ac78-c33ac869c013 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:13.615846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cd8e0-908e-4324-ac78-c33ac869c013 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:13.616130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4cd8e0-908e-4324-ac78-c33ac869c013 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:13.618279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cd8e0-908e-4324-ac78-c33ac869c013 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:13.620817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4cd8e0-908e-4324-ac78-c33ac869c013 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:13.635719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1145/2331] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:13 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:13.637643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:13.652572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b21ed99-5e8b-4025-9caf-968bec3cd899 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:13.658947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:13.660358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:13.661127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:13.661127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] PATH_INFO: `/v3/projects/f2d7a712d21d458da73bba01a2aefe84/users/47a7461e23af48af9de1b10f57077abc/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:13.663845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f2d7a712d21d458da73bba01a2aefe84, user_id=47a7461e23af48af9de1b10f57077abc, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:13.670290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:13.719564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1187/2332] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:13 2022] PUT /identity/v3/projects/f2d7a712d21d458da73bba01a2aefe84/users/47a7461e23af48af9de1b10f57077abc/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 74 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:13.721353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:13.721762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:13.722155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:13.761661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] MFA Rules not processed for user `47a7461e23af48af9de1b10f57077abc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:13.763163 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:13.824918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:13.870755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1146/2333] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:13 2022] POST /identity/v3/auth/tokens => generated 3337 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:13.900239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:13.904760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:13.994057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30142a71-4f97-4d8c-9ca2-8f20667d0259 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:14.003653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:14.004319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:14.007548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:14.007548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:14.018984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:14.020495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:14.037883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1188/2334] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:13 2022] GET /identity/v3/auth/tokens => generated 3337 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:14.215922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:14.283438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:14.288296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:14.312250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:14.373229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02bcb6b9-7efa-47f8-bacc-e24661bd377f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:14.382726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:14.384114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:14.385035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:14.385669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] PATH_INFO: `/v3/users/0455a734687940cbbc0b2c94ef51e787` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:14.391429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0455a734687940cbbc0b2c94ef51e787)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:14.392426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:14.425100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d82c506-aedd-49c1-8add-d2d7070ef1eb service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:14.438733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:14.440567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:14.441046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:14.441406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:14.444003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:14.462948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:14.464688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc231df2-8b5f-45cd-8962-ed9f34513cb4 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:14.490290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1189/2335] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 206 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:14.668152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0455a734687940cbbc0b2c94ef51e787'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:14.685470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0455a734687940cbbc0b2c94ef51e787'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:14.727716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0455a734687940cbbc0b2c94ef51e787'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:14.730852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0455a734687940cbbc0b2c94ef51e787'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:14.848694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0455a734687940cbbc0b2c94ef51e787'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:14.861736 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1147/2336] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:14 2022] DELETE /identity/v3/users/0455a734687940cbbc0b2c94ef51e787 => generated 0 bytes in 646 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:14.867312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f357-bed7-4b6c-b3b8-f18c5737e2d6 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:14.867894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f357-bed7-4b6c-b3b8-f18c5737e2d6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:14.868696 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09e7f357-bed7-4b6c-b3b8-f18c5737e2d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:14.909482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-09e7f357-bed7-4b6c-b3b8-f18c5737e2d6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:14.911560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-09e7f357-bed7-4b6c-b3b8-f18c5737e2d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:15.043380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1190/2337] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:15.044040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:15.045322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:15.177556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ed2788f-d2cd-47b2-aa09-4217fa8a3243 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:15.183314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:15.184055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:15.184347 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:15.184618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:15.193152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:15.193509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:15.193718 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:15.196989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:15.198660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:15.213446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1148/2338] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:15 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:21:15.226573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] MFA Rules not processed for user `0cdcf5b8d45e45a9bd027a48efe992f2`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:15.227934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:15.339395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1191/2339] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:15.351537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:15.352981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:15.359006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:15.509207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd478cc7-746d-4ee8-b60c-3cd2bf5f8e77 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:15.529996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:15.533170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:15.533613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:15.534184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:15.537790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:15.648096 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:15.649732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:15.670623 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1149/2340] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:15.819362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:15.821027 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:15.837930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aabc6bc4-907f-4626-808f-b16f7875121b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:15.848810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:15.848810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:15.848810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:15.848810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] PATH_INFO: `/v3/projects/f765591df09b4f27abca0067209808bf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:15.849575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=f765591df09b4f27abca0067209808bf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:15.849575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:15.862515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:15.991600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f765591df09b4f27abca0067209808bf', 'request_id': 'req-41a7a394-87e5-4fe9-9cd9-abed481b35ac'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:15.997557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f765591df09b4f27abca0067209808bf', 'request_id': 'req-41a7a394-87e5-4fe9-9cd9-abed481b35ac'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.005966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f765591df09b4f27abca0067209808bf', 'request_id': 'req-41a7a394-87e5-4fe9-9cd9-abed481b35ac'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.106358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] The token cache is being invalidate because project f765591df09b4f27abca0067209808bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:16.106358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.106358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.106358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1192/2341] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:15 2022] DELETE /identity/v3/projects/f765591df09b4f27abca0067209808bf => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:16.107247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:16.117974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d3854fe-77f2-4e5a-bf15-c377f4500fd0 service nova] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:16.189781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:16.193548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:16.193548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:16.193548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] PATH_INFO: `/v3/users/47a7461e23af48af9de1b10f57077abc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:16.197306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] RBAC: Authorizing `identity:delete_user(user_id=47a7461e23af48af9de1b10f57077abc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:16.198624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:16.430619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:16.435700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '47a7461e23af48af9de1b10f57077abc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.443012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '47a7461e23af48af9de1b10f57077abc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.457563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '47a7461e23af48af9de1b10f57077abc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.458302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '47a7461e23af48af9de1b10f57077abc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.587348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-171bed06-d4c4-4f15-b829-60fdcba4374d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '47a7461e23af48af9de1b10f57077abc'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:16.595309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1150/2342] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:16 2022] DELETE /identity/v3/users/47a7461e23af48af9de1b10f57077abc => generated 0 bytes in 490 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:17.158330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:17.159828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:17.186197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a7a394-87e5-4fe9-9cd9-abed481b35ac admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:17.272410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:17.272975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:17.273262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:17.273544 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] PATH_INFO: `/v3/projects/f2d7a712d21d458da73bba01a2aefe84` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:17.274803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f2d7a712d21d458da73bba01a2aefe84)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:17.276935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:17.396763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f2d7a712d21d458da73bba01a2aefe84', 'request_id': 'req-411da01b-1357-4f5d-ad8f-51cbc4bf2317'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:17.403033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f2d7a712d21d458da73bba01a2aefe84', 'request_id': 'req-411da01b-1357-4f5d-ad8f-51cbc4bf2317'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:17.411207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f2d7a712d21d458da73bba01a2aefe84', 'request_id': 'req-411da01b-1357-4f5d-ad8f-51cbc4bf2317'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:17.523661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] The token cache is being invalidate because project f2d7a712d21d458da73bba01a2aefe84 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:17.523963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:17.524650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-411da01b-1357-4f5d-ad8f-51cbc4bf2317 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:17.526295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1193/2343] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:17 2022] DELETE /identity/v3/projects/f2d7a712d21d458da73bba01a2aefe84 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:17.531213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:17.531711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:17.531809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:17.551499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:17.552698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:17.618714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1151/2344] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:17.627013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:17.627304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:17.627583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:17.646414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:17.647620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:17.655684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1194/2345] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:17.660033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:17.669976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecde6b2a-2737-4a9b-af54-58b3757e3bb5 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:17.675389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:17.676401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:17.676686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:17.677137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:17.677884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:17.678228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:17.679888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:17.693557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1152/2346] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:17.698020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:17.707911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c031d254-1d31-411b-a9a1-75dbaa6ad154 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:17.712892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:17.713558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:17.713905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:17.714217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:17.714983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:17.716957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:17.830767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1195/2347] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:17 2022] POST /identity/v3/projects => generated 363 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:17.835467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:17.846506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b887198-839b-4e99-b177-7130dcf01cc9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:17.907769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:17.908426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:17.908730 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:17.909008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:17.909702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:17.911662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.005482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1153/2348] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:17 2022] POST /identity/v3/users => generated 282 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:18.009613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.015403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:18.021351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9369a8a-bbe8-448c-b208-d1d4cb708733 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.026719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.027469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.027748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.028022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.028801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.030557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.041956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1196/2349] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:18.046051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.056670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b73bbb9-c903-4d94-98bc-4ba90a9ea95e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.064773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab340307-68cc-4bbf-97a5-d1a6ac510977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.065478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340307-68cc-4bbf-97a5-d1a6ac510977 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.065761 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340307-68cc-4bbf-97a5-d1a6ac510977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.066114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab340307-68cc-4bbf-97a5-d1a6ac510977 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.066853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab340307-68cc-4bbf-97a5-d1a6ac510977 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.068494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab340307-68cc-4bbf-97a5-d1a6ac510977 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.083666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1154/2350] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:18.087929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.100273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f576a42f-99fa-4c3e-867d-ed530f43a532 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.105593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.106521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.106803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.107078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] PATH_INFO: `/v3/projects/df5ec91e7c7148279d3c2054dbcf9840/users/d2d1f842d1404495aeea909081202a2f/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.128494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=df5ec91e7c7148279d3c2054dbcf9840, user_id=d2d1f842d1404495aeea909081202a2f, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.131458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.248642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1197/2351] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:18 2022] PUT /identity/v3/projects/df5ec91e7c7148279d3c2054dbcf9840/users/d2d1f842d1404495aeea909081202a2f/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:18.260392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.260688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.260969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.291491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] MFA Rules not processed for user `d2d1f842d1404495aeea909081202a2f`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:18.292710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:18.305694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:18.370939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1155/2352] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:18 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:18.372869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.455678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7f0f25f-3b71-47b5-a14c-8f2373aa70b0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.460398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.461052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.461336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.461610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.462360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.464419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.564375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1198/2353] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:18 2022] POST /identity/v3/projects => generated 365 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:18.567335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.587502 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78f9bd9-645d-488e-a2b2-603ee597c6aa None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.661753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.662573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.662857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.663136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.663928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.665961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.753495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1156/2354] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:18 2022] POST /identity/v3/users => generated 289 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:18.757588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.771348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a4742a-8bfd-4abf-ad80-4cf26f8aef8f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.776885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b2be79-08f1-4486-b842-55c0e0f421b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.777668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2be79-08f1-4486-b842-55c0e0f421b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.778085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2be79-08f1-4486-b842-55c0e0f421b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.778530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b2be79-08f1-4486-b842-55c0e0f421b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.779375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2be79-08f1-4486-b842-55c0e0f421b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.781118 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b2be79-08f1-4486-b842-55c0e0f421b8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.793572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1199/2355] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:18.799973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.810260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3b82d36-9434-4dc5-a0d1-f7f361d36156 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:18.828690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.828984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.829275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.837296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:18.838233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:18.838516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:18.838795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] PATH_INFO: `/v3/projects/0b7e3e1e2d2e4d879381979c68570c7c/users/765feb2bcfb044b59b3b99cadd157aef/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:18.858276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] MFA Rules not processed for user `859a278562b24044910f65508d7c30aa`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:18.859516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:18.869336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7e3e1e2d2e4d879381979c68570c7c, user_id=765feb2bcfb044b59b3b99cadd157aef, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:18.872804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:18.926737 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1200/2356] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:18.965924 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1157/2357] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:18 2022] PUT /identity/v3/projects/0b7e3e1e2d2e4d879381979c68570c7c/users/765feb2bcfb044b59b3b99cadd157aef/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:18.972880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:18.998354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171111b8-ddd4-4528-81d2-ea34d6b0377a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:19.085667 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:19.100919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e67632-50ed-4364-94fd-2262bca0a332 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:19.101599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67632-50ed-4364-94fd-2262bca0a332 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:19.101888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67632-50ed-4364-94fd-2262bca0a332 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:19.102217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e67632-50ed-4364-94fd-2262bca0a332 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:19.102971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67632-50ed-4364-94fd-2262bca0a332 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:19.104939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e67632-50ed-4364-94fd-2262bca0a332 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:19.116768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1201/2358] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:18 2022] GET /identity/v3/roles => generated 1420 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:19.120734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:19.133260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf1a61d-6e40-4ff8-b4af-a32c5bf8f892 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:19.139367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:19.140936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:19.142779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:19.142779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] PATH_INFO: `/v3/projects/0b7e3e1e2d2e4d879381979c68570c7c/users/765feb2bcfb044b59b3b99cadd157aef/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:19.144602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b7e3e1e2d2e4d879381979c68570c7c, user_id=765feb2bcfb044b59b3b99cadd157aef, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:19.147245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:19.172677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1158/2359] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:19 2022] PUT /identity/v3/projects/0b7e3e1e2d2e4d879381979c68570c7c/users/765feb2bcfb044b59b3b99cadd157aef/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:19.175366 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:19.175661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:19.176193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:19.253641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] MFA Rules not processed for user `765feb2bcfb044b59b3b99cadd157aef`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:19.258485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:19.365882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1202/2360] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:19 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:19.372853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:19.375412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:19.456092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe1e27d-ca36-4934-901d-3c76ff8d62e2 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:19.460157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:19.460825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:19.467120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:19.467120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:19.474988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:19.476571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:19.493485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1159/2361] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:19 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:19.733301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:19.751256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b19b000-bf98-4aba-b651-1c8d2ea4bc9f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:19.755676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:19.757133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:19.757660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:19.758267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:19.836719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:19.838233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:19.850160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1203/2362] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:19 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:21.479743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:21.481235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:21.493733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:21.544643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cb81d0f-7e10-4322-a516-81d565a2aa61 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:21.549011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:21.549665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:21.549951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:21.550261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:21.552068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:21.617790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:21.619307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:21.630002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1160/2363] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:21 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:25.592986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:25.594562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:25.619779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5122c14-9795-4dba-bb0a-89ea20751366 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:25.626810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:25.627841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:25.628219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:25.628597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] PATH_INFO: `/v3/users/63116783cc3f4f84a11027d5bfdab705` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:25.629893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] RBAC: Authorizing `identity:delete_user(user_id=63116783cc3f4f84a11027d5bfdab705)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:25.631952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:25.815198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '63116783cc3f4f84a11027d5bfdab705'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:25.826303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:25.828731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '63116783cc3f4f84a11027d5bfdab705'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:25.836094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '63116783cc3f4f84a11027d5bfdab705'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:25.836841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '63116783cc3f4f84a11027d5bfdab705'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:25.933305 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7a83d3fe-d1ad-4caf-8b56-c1c9755ddc56 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '63116783cc3f4f84a11027d5bfdab705'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:25.941443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1204/2364] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:25 2022] DELETE /identity/v3/users/63116783cc3f4f84a11027d5bfdab705 => generated 0 bytes in 349 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:26.205716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:26.215958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0185c5-1515-41ee-9408-fde886ce8d28 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:26.279795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:26.280725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:26.280994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:26.281298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] PATH_INFO: `/v3/projects/f9cce405a4ce4b889bd3deadc4b48790` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:26.282564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] RBAC: Authorizing `identity:delete_project(project_id=f9cce405a4ce4b889bd3deadc4b48790)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:26.285112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:26.427050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f9cce405a4ce4b889bd3deadc4b48790', 'request_id': 'req-9f87d706-c648-46fe-b6b5-781ebeb3224d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:26.432489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f9cce405a4ce4b889bd3deadc4b48790', 'request_id': 'req-9f87d706-c648-46fe-b6b5-781ebeb3224d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:26.434340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=94,keystone:DELETE=6 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:26.438699 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f9cce405a4ce4b889bd3deadc4b48790', 'request_id': 'req-9f87d706-c648-46fe-b6b5-781ebeb3224d'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:26.529145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] The token cache is being invalidate because project f9cce405a4ce4b889bd3deadc4b48790 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:26.529558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:26.533261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9f87d706-c648-46fe-b6b5-781ebeb3224d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:26.533261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1161/2365] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:26 2022] DELETE /identity/v3/projects/f9cce405a4ce4b889bd3deadc4b48790 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:26.537043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:26.537837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:26.538157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:26.564504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:26.565727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:26.632286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1205/2366] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:26.640751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:26.641069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:26.641348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:26.660618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:26.661820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:26.669752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1162/2367] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:26.674241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:26.684116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3237dc2d-dfa2-4073-bb41-48835ca018e6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:26.688941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:26.689605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:26.689887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:26.690197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:26.690964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:26.691272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:26.693062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:26.707127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1206/2368] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:26.713770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:26.723723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277e1785-f0bd-4578-80e0-314e66322045 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:26.728588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:26.729248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:26.729537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:26.729806 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:26.731193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:26.733177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:26.814731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1163/2369] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:26 2022] POST /identity/v3/projects => generated 403 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:26.819425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:26.830468 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a13db85-19f0-4f30-97ee-b51c2090fdb1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:26.902555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:26.903226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:26.903510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:26.903789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:26.904472 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:26.906412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:26.998741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1207/2370] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:26 2022] POST /identity/v3/users => generated 302 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:27.003569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:27.016206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a8fea7-fd08-4e36-913a-18c2d3d845a1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:27.024098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:27.024773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:27.025053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:27.025326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:27.026117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:27.027735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:27.038893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1164/2371] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:27.042868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:27.054480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72e412b8-82d7-42d3-93e4-6f3970654402 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:27.059188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7acb2149-238f-45e2-a426-5e83c535934b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:27.059855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb2149-238f-45e2-a426-5e83c535934b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:27.060242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb2149-238f-45e2-a426-5e83c535934b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:27.060479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7acb2149-238f-45e2-a426-5e83c535934b admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:27.061280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb2149-238f-45e2-a426-5e83c535934b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:27.062916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7acb2149-238f-45e2-a426-5e83c535934b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:27.074996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1208/2372] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:27 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:27.079216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:27.091524 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c4f9e8-7cbc-4171-9515-c9ec67bcc19a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:27.096050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:27.096969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:27.097254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:27.097534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] PATH_INFO: `/v3/projects/0926300d1ac9406a86e5e03450576e5d/users/61ccb43ba3e94a85be6c996b035e20e3/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:27.112117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] RBAC: Authorizing `identity:create_grant(project_id=0926300d1ac9406a86e5e03450576e5d, user_id=61ccb43ba3e94a85be6c996b035e20e3, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:27.115126 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:27.193216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1165/2373] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:27 2022] PUT /identity/v3/projects/0926300d1ac9406a86e5e03450576e5d/users/61ccb43ba3e94a85be6c996b035e20e3/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:27.198436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e2407-0319-4b51-8ad8-26902c5d5bdd None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:27.198792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e2407-0319-4b51-8ad8-26902c5d5bdd None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:27.199134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa6e2407-0319-4b51-8ad8-26902c5d5bdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:27.220928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-fa6e2407-0319-4b51-8ad8-26902c5d5bdd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:27.222216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fa6e2407-0319-4b51-8ad8-26902c5d5bdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:27.265530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:27.284056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1209/2374] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:27.295528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:27.295528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:27.356763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eabdcc09-6605-49e9-93a8-4c0c0fc12b4a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:27.365281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:27.365281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:27.365281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:27.365281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:27.373074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:27.374552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:27.385372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1166/2375] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:28.750349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:28.750829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:28.750829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:28.782286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] MFA Rules not processed for user `61ccb43ba3e94a85be6c996b035e20e3`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:28.783954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:28.851154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1210/2376] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:28 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:28.855776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:28.866085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e869f4-1283-4304-8503-488be686285f service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:28.870969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:28.871755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:28.872100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:28.872437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:28.873196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:28.875213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:28.881786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:28.883252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:28.896885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f81051-4996-4a50-b8c0-dfd1622f70e0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:28.901723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:28.904731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:28.904731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:28.904731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] PATH_INFO: `/v3/users/d2d1f842d1404495aeea909081202a2f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:28.904731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d2d1f842d1404495aeea909081202a2f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:28.906439 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:28.960416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1167/2377] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:28 2022] POST /identity/v3/projects => generated 405 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:28.964477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.027823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b4f0cb-d926-48d3-a0f6-20f92afc2ef3 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:29.032614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:29.033273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.033563 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.033844 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.034622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:29.040564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:29.046078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:INSERT=7,keystone:DELETE=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:29.098679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd2d1f842d1404495aeea909081202a2f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:29.110475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd2d1f842d1404495aeea909081202a2f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:29.118971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd2d1f842d1404495aeea909081202a2f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:29.121095 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd2d1f842d1404495aeea909081202a2f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:29.121484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1168/2378] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:28 2022] POST /identity/v3/users => generated 309 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:29.124692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.143864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73aa50c3-9c2f-4d1a-864c-b1c22706539a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:29.148893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:29.149721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.149877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.150196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.150926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:29.152528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:29.164729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1169/2379] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:29.168548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.179310 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a094ea7b-3619-4ee5-991f-3d7e7d3fabc3 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:29.183998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:29.184971 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.185254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.185532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] PATH_INFO: `/v3/projects/03a9cd672f82468eaac83ddcf73b0d8c/users/60aa246aeb484c78a0701ea4a8a8f41c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.200781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9cd672f82468eaac83ddcf73b0d8c, user_id=60aa246aeb484c78a0701ea4a8a8f41c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:29.204572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:29.248621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c577943a-950e-42ac-a754-9da86f607683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd2d1f842d1404495aeea909081202a2f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:29.248621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1211/2380] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:28 2022] DELETE /identity/v3/users/d2d1f842d1404495aeea909081202a2f => generated 0 bytes in 351 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:29.248621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.248621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.248621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.263818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:29.265025 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:29.295405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1170/2381] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:29 2022] PUT /identity/v3/projects/03a9cd672f82468eaac83ddcf73b0d8c/users/60aa246aeb484c78a0701ea4a8a8f41c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:29.299236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.301560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:29.309534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:29.327144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1212/2382] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:29.337605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.339120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:29.372890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d60576-4126-42f1-ba1a-8c54fee2c8c9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:29.377600 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:29.378344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.378664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.378945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.379717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:29.381316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:29.394845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1171/2383] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:29 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:29.399248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.399385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3433daa-f3b7-4371-9ee1-30460de42bb1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:29.405629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8387c2f5-7d63-4307-8c66-7d9841438f66 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:29.410751 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:29.411610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.411895 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.412323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] PATH_INFO: `/v3/projects/03a9cd672f82468eaac83ddcf73b0d8c/users/60aa246aeb484c78a0701ea4a8a8f41c/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.414322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] RBAC: Authorizing `identity:create_grant(project_id=03a9cd672f82468eaac83ddcf73b0d8c, user_id=60aa246aeb484c78a0701ea4a8a8f41c, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:29.416992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:29.428488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1172/2384] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:29 2022] PUT /identity/v3/projects/03a9cd672f82468eaac83ddcf73b0d8c/users/60aa246aeb484c78a0701ea4a8a8f41c/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:29.453217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:29.453908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:29.454320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:29.454948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:29.467541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:29.467541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:29.477896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1213/2385] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:29 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:21:29.984937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:29.988195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:30.073772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f132fa-60dd-44ee-bf65-cc1019f40711 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:30.078399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:30.079263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:30.079550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:30.080040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] PATH_INFO: `/v3/projects/df5ec91e7c7148279d3c2054dbcf9840` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:30.081819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=df5ec91e7c7148279d3c2054dbcf9840)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:30.083926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:30.177348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=2,keystone:DELETE=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:30.180275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'df5ec91e7c7148279d3c2054dbcf9840', 'request_id': 'req-de573c2f-dbb2-45b5-9a79-7f44737e66ec'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.185664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'df5ec91e7c7148279d3c2054dbcf9840', 'request_id': 'req-de573c2f-dbb2-45b5-9a79-7f44737e66ec'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.192570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'df5ec91e7c7148279d3c2054dbcf9840', 'request_id': 'req-de573c2f-dbb2-45b5-9a79-7f44737e66ec'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.280830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] The token cache is being invalidate because project df5ec91e7c7148279d3c2054dbcf9840 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:30.282497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.282497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de573c2f-dbb2-45b5-9a79-7f44737e66ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.287104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1173/2386] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:29 2022] DELETE /identity/v3/projects/df5ec91e7c7148279d3c2054dbcf9840 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:30.293583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:30.304319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d2b3d62-c5cf-4339-b916-bba53d72f09b service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:30.365757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:30.366555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:30.366850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:30.367146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] PATH_INFO: `/v3/users/765feb2bcfb044b59b3b99cadd157aef` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:30.368715 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] RBAC: Authorizing `identity:delete_user(user_id=765feb2bcfb044b59b3b99cadd157aef)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:30.370729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:30.595645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '765feb2bcfb044b59b3b99cadd157aef'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.596446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:30.621618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '765feb2bcfb044b59b3b99cadd157aef'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.629777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '765feb2bcfb044b59b3b99cadd157aef'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.630642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '765feb2bcfb044b59b3b99cadd157aef'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.729456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '765feb2bcfb044b59b3b99cadd157aef'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:30.742344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bb03-f2b7-4521-8b55-005895290e87 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:30.743015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bb03-f2b7-4521-8b55-005895290e87 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:30.743533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b568bb03-f2b7-4521-8b55-005895290e87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:30.746203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1214/2387] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:30 2022] DELETE /identity/v3/users/765feb2bcfb044b59b3b99cadd157aef => generated 0 bytes in 459 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:30.773013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b568bb03-f2b7-4521-8b55-005895290e87 None None] MFA Rules not processed for user `60aa246aeb484c78a0701ea4a8a8f41c`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:30.773996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b568bb03-f2b7-4521-8b55-005895290e87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:30.847487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1174/2388] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:30 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:31.251419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:31.252921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:31.330410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d110ceb1-4aa4-4fbb-a2dd-78bfd527ac91 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:31.335551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:31.336411 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:31.336691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:31.336964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] PATH_INFO: `/v3/projects/0b7e3e1e2d2e4d879381979c68570c7c` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:31.338172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b7e3e1e2d2e4d879381979c68570c7c)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:31.340231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:31.449382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b7e3e1e2d2e4d879381979c68570c7c', 'request_id': 'req-c684801a-a030-4657-a616-01820834b7f8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:31.455130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b7e3e1e2d2e4d879381979c68570c7c', 'request_id': 'req-c684801a-a030-4657-a616-01820834b7f8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:31.463349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b7e3e1e2d2e4d879381979c68570c7c', 'request_id': 'req-c684801a-a030-4657-a616-01820834b7f8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:31.542955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] The token cache is being invalidate because project 0b7e3e1e2d2e4d879381979c68570c7c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:31.543331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:31.544086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c684801a-a030-4657-a616-01820834b7f8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:31.546297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1215/2389] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:31 2022] DELETE /identity/v3/projects/0b7e3e1e2d2e4d879381979c68570c7c => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:31.551040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:31.551547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:31.551640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:31.586257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:31.586257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:31.683290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1175/2390] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:31.683790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:31.683790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:31.683790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:31.683790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:31.684887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:31.696845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1216/2391] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:31.698261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:31.708789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b4ba825-a618-4c65-8ff7-608e7ae46a7d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:31.713423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:31.714105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:31.714387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:31.714693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:31.715421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:31.715724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:31.717372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:31.729988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1176/2392] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:31.736500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:31.744889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-031ed8e0-b033-4cd6-b355-04845b5d689d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:31.749839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:31.750532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:31.750814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:31.751091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:31.751823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:31.754399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:31.834709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1217/2393] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:31 2022] POST /identity/v3/projects => generated 387 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:31.835941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:31.846068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-132bf692-77ad-4a31-8550-e81e42180cf1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:31.890280 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:31.902715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:31.903318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:31.903625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:31.903936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:31.904622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:31.906602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.024861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1177/2394] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:31 2022] POST /identity/v3/users => generated 294 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:32.029276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.040082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a0de47-a113-4381-9be4-64a31ff87a8e admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.045067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.045869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.046261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.046545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.047284 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.048941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.060239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1218/2395] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:32.064312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.075106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-601ea6fa-7cb5-459a-a8f8-6da6e95af626 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.080037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a64d65-043f-489d-a049-3ae8d0a8344e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.080802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a64d65-043f-489d-a049-3ae8d0a8344e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.081199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a64d65-043f-489d-a049-3ae8d0a8344e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.081542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a64d65-043f-489d-a049-3ae8d0a8344e admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.082389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a64d65-043f-489d-a049-3ae8d0a8344e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.084718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a64d65-043f-489d-a049-3ae8d0a8344e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.095658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1178/2396] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:32.100047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.110123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fb8b9ff-8cda-4c26-84ae-001d9bd636ab admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.115296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.116168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.116450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.116727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] PATH_INFO: `/v3/projects/e15d95c758a1424ca13b4013414d5765/users/cb0b6dbf77ce4e0e90f8c735f23e6f99/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.128831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:DELETE=10,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:32.132549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] RBAC: Authorizing `identity:create_grant(project_id=e15d95c758a1424ca13b4013414d5765, user_id=cb0b6dbf77ce4e0e90f8c735f23e6f99, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.135365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.204932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1219/2397] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:32 2022] PUT /identity/v3/projects/e15d95c758a1424ca13b4013414d5765/users/cb0b6dbf77ce4e0e90f8c735f23e6f99/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:32.216497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.217042 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.217471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.244505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] MFA Rules not processed for user `cb0b6dbf77ce4e0e90f8c735f23e6f99`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:32.245726 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:32.309830 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1179/2398] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:32 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:32.314735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.334427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.335897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:32.386518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f29ce5a3-edbb-480e-a0c5-940178a9e47c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.391200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.391861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.392147 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.392433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.393155 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.395797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.404355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3304ccac-5986-4412-8cb7-7ae586ac0fc0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.408908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.409784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.410092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.410467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] PATH_INFO: `/v3/users/61ccb43ba3e94a85be6c996b035e20e3` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.411605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] RBAC: Authorizing `identity:delete_user(user_id=61ccb43ba3e94a85be6c996b035e20e3)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.413545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.502441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1220/2399] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:32 2022] POST /identity/v3/projects => generated 387 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:32.503570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.563738 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb9f3f32-abb1-4131-9966-fb654307934c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.569058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.569717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.569999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.570939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.571048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.572883 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.602750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61ccb43ba3e94a85be6c996b035e20e3'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:32.609421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61ccb43ba3e94a85be6c996b035e20e3'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:32.610547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:INSERT=3,keystone:DELETE=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:32.622327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61ccb43ba3e94a85be6c996b035e20e3'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:32.623007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61ccb43ba3e94a85be6c996b035e20e3'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:32.685350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1221/2400] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:32 2022] POST /identity/v3/users => generated 300 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:32.688765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.699830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a31538-6e00-47b0-ad93-526c0d405cf3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.700597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61ccb43ba3e94a85be6c996b035e20e3'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:32.707485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.709288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.709288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.709717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.710296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.713360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.716278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1180/2401] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:32 2022] DELETE /identity/v3/users/61ccb43ba3e94a85be6c996b035e20e3 => generated 0 bytes in 382 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:32.727109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1222/2402] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:32.731376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.732862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:32.803927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5142e087-e3cc-4c17-a4d8-495a74740d0e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.806646 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.807545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.807914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.808102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] PATH_INFO: `/v3/projects/12f497697d5e432388ec196803def7a1/users/522daaf5b81e4af1b0b2f4fc58647254/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.823774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f497697d5e432388ec196803def7a1, user_id=522daaf5b81e4af1b0b2f4fc58647254, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.826474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.900027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1181/2403] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:32 2022] PUT /identity/v3/projects/12f497697d5e432388ec196803def7a1/users/522daaf5b81e4af1b0b2f4fc58647254/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 169 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:32.904228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:32.917908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-691a72ac-4a36-4b6f-b6e0-83a1f531ddc7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:32.974923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:32.982126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:32.982815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:32.983099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:32.983415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:32.984132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:32.985723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:32.996847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1223/2404] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:32 2022] GET /identity/v3/roles => generated 1420 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:33.003864 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:33.011673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-656494ff-a6bd-4d2d-8031-406837556dd1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:33.016389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48920d49-c0f0-4145-9472-48580296d1c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:33.017260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920d49-c0f0-4145-9472-48580296d1c3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:33.017542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920d49-c0f0-4145-9472-48580296d1c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:33.017835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48920d49-c0f0-4145-9472-48580296d1c3 admin admin] PATH_INFO: `/v3/projects/12f497697d5e432388ec196803def7a1/users/522daaf5b81e4af1b0b2f4fc58647254/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:33.019918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48920d49-c0f0-4145-9472-48580296d1c3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12f497697d5e432388ec196803def7a1, user_id=522daaf5b81e4af1b0b2f4fc58647254, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:33.022757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48920d49-c0f0-4145-9472-48580296d1c3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:33.027742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:33.030550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:33.041092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1182/2405] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:32 2022] PUT /identity/v3/projects/12f497697d5e432388ec196803def7a1/users/522daaf5b81e4af1b0b2f4fc58647254/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:33.048957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1726a61b-f3de-42b4-9166-f5abb26b8dc3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:33.050119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:33.050584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:33.050916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:33.087263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] MFA Rules not processed for user `522daaf5b81e4af1b0b2f4fc58647254`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:33.092603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:33.110163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:33.111087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:33.111375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:33.111647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] PATH_INFO: `/v3/projects/0926300d1ac9406a86e5e03450576e5d` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:33.113139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] RBAC: Authorizing `identity:delete_project(project_id=0926300d1ac9406a86e5e03450576e5d)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:33.115765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:33.157349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1183/2406] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:33 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:33.168548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:33.170159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:33.200771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:33.225886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce759032-5bd2-4b42-888c-94f154ab8214 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:33.229509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:33.233118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:33.233118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:33.233118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:33.240622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:33.241565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0926300d1ac9406a86e5e03450576e5d', 'request_id': 'req-2602525c-c416-48b4-824e-7359d9b2fa0b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.242076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:33.246953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0926300d1ac9406a86e5e03450576e5d', 'request_id': 'req-2602525c-c416-48b4-824e-7359d9b2fa0b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.252112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1184/2407] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:33 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:21:33.253270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0926300d1ac9406a86e5e03450576e5d', 'request_id': 'req-2602525c-c416-48b4-824e-7359d9b2fa0b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.372965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] The token cache is being invalidate because project 0926300d1ac9406a86e5e03450576e5d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:33.373259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.373904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.375476 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1224/2408] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:33 2022] DELETE /identity/v3/projects/0926300d1ac9406a86e5e03450576e5d => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:33.379656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:33.390333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d1305f-79f6-49bd-b27e-7174aad851b3 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:33.446712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:33.447487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:33.447765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:33.448038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] PATH_INFO: `/v3/users/60aa246aeb484c78a0701ea4a8a8f41c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:33.449202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] RBAC: Authorizing `identity:delete_user(user_id=60aa246aeb484c78a0701ea4a8a8f41c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:33.451180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:33.674979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '60aa246aeb484c78a0701ea4a8a8f41c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.683902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '60aa246aeb484c78a0701ea4a8a8f41c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.700039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '60aa246aeb484c78a0701ea4a8a8f41c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.700773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '60aa246aeb484c78a0701ea4a8a8f41c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.780491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '60aa246aeb484c78a0701ea4a8a8f41c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:33.787156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1185/2409] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:33 2022] DELETE /identity/v3/users/60aa246aeb484c78a0701ea4a8a8f41c => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:34.058462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.060166 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.120473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2602525c-c416-48b4-824e-7359d9b2fa0b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:34.131292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.132698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.172158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:34.197474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:34.197474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.197474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.197474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.197923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.205852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:34.206762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c029bf23-b2e9-4114-a30e-2598afceaefb admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:34.207546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c2093e-6c64-4b13-ac18-4328d4f5b4a7 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:34.211791 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:34.213469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.213469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.213469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] PATH_INFO: `/v3/projects/03a9cd672f82468eaac83ddcf73b0d8c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.214669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03a9cd672f82468eaac83ddcf73b0d8c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:34.220537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1225/2410] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:34 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:34.220664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:34.333179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:34.382328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03a9cd672f82468eaac83ddcf73b0d8c', 'request_id': 'req-5b802ae5-5705-4292-abe0-c85cc0482659'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.393389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03a9cd672f82468eaac83ddcf73b0d8c', 'request_id': 'req-5b802ae5-5705-4292-abe0-c85cc0482659'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.400429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03a9cd672f82468eaac83ddcf73b0d8c', 'request_id': 'req-5b802ae5-5705-4292-abe0-c85cc0482659'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.463963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] The token cache is being invalidate because project 03a9cd672f82468eaac83ddcf73b0d8c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:34.464263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.464912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.467560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1186/2411] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:34 2022] DELETE /identity/v3/projects/03a9cd672f82468eaac83ddcf73b0d8c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:34.471608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528896-e93e-47c9-836e-9d5f33fa20e5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.472055 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528896-e93e-47c9-836e-9d5f33fa20e5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.472337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c528896-e93e-47c9-836e-9d5f33fa20e5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.491795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7c528896-e93e-47c9-836e-9d5f33fa20e5 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:34.492987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7c528896-e93e-47c9-836e-9d5f33fa20e5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.549454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.551243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.562393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1226/2412] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:34.571044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.571328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.571601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.590698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:34.591934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.600351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1227/2413] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:34.604363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.613299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e902edab-092f-4669-9583-c36a4c58df46 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:34.620102 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:34.621225 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.621673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.622158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.623065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:34.623562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:34.625587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:34.628464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b802ae5-5705-4292-abe0-c85cc0482659 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:34.634966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:34.635854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.636142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.636425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] PATH_INFO: `/v3/users/cb0b6dbf77ce4e0e90f8c735f23e6f99` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.637715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb0b6dbf77ce4e0e90f8c735f23e6f99)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:34.641709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1228/2414] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:21:34.641904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:34.642938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.653475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-427dd109-5816-4620-9180-cb780559db44 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:34.658310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:34.658957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.659295 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.659574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.660259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:34.662735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:34.768336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1229/2415] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:34 2022] POST /identity/v3/projects => generated 383 bytes in 126 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:34.772801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.832426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a70d568-66cf-4ff1-b87a-dd63090cac93 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:34.837861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:34.838552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:34.838835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:34.839112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:34.839794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:34.841706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:34.857951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb0b6dbf77ce4e0e90f8c735f23e6f99'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.864970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb0b6dbf77ce4e0e90f8c735f23e6f99'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.876957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb0b6dbf77ce4e0e90f8c735f23e6f99'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.877799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb0b6dbf77ce4e0e90f8c735f23e6f99'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.959973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1230/2416] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:34 2022] POST /identity/v3/users => generated 292 bytes in 186 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:34.959973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.962140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:34.980899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb0b6dbf77ce4e0e90f8c735f23e6f99'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:34.991582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1187/2417] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:34 2022] DELETE /identity/v3/users/cb0b6dbf77ce4e0e90f8c735f23e6f99 => generated 0 bytes in 443 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:34.992687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:34.994052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:35.032915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0265fab-0a20-4ec3-ad82-f3244f12ab89 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.063938 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1261f06b-b53d-445c-9b67-79a97300160e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.069283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f828678b-fb35-4929-a95f-2345472f7890 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.069951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828678b-fb35-4929-a95f-2345472f7890 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.070277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828678b-fb35-4929-a95f-2345472f7890 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.070560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f828678b-fb35-4929-a95f-2345472f7890 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.071293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828678b-fb35-4929-a95f-2345472f7890 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.072917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f828678b-fb35-4929-a95f-2345472f7890 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.082952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1188/2418] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:34 2022] GET /identity/v3/roles => generated 1420 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:35.086859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.086859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.086859 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.096032 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.096688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.096972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.097250 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.099164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:35.102719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:35.103890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:35.110623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.112229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.112359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1189/2419] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:35.115957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.122813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dd90099-402b-463c-94df-fa4dcf7f3230 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.123257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1231/2420] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:34 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 164 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:35.132998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.132998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.132998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.132998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.133390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.133496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.133588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:35.133679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.144870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1190/2421] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:35.149084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.159619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cd4895c-54a3-4d91-afdd-7cd59de5728f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.164828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.165989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.166308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.167339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] PATH_INFO: `/v3/projects/e20a68cc2d3e458daba75d61eb10f155/users/6bb19bf199624f87807890954813ea6e/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.206083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aef6de6-fc28-4924-9eea-8291291cc7a7 service placement] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.211642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b181be65-b9a3-44bf-96e6-72e827fae016 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.213299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181be65-b9a3-44bf-96e6-72e827fae016 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.213299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181be65-b9a3-44bf-96e6-72e827fae016 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.213299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b181be65-b9a3-44bf-96e6-72e827fae016 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.213695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e20a68cc2d3e458daba75d61eb10f155, user_id=6bb19bf199624f87807890954813ea6e, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.215614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.224860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181be65-b9a3-44bf-96e6-72e827fae016 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.226885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b181be65-b9a3-44bf-96e6-72e827fae016 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.236230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:35.242222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1232/2422] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:21:35.300737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1191/2423] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:35 2022] PUT /identity/v3/projects/e20a68cc2d3e458daba75d61eb10f155/users/6bb19bf199624f87807890954813ea6e/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:35.310794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358768-5000-4d03-aae5-83fa166da679 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.311086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358768-5000-4d03-aae5-83fa166da679 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.311235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:35.311367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53358768-5000-4d03-aae5-83fa166da679 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.343859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-53358768-5000-4d03-aae5-83fa166da679 None None] MFA Rules not processed for user `6bb19bf199624f87807890954813ea6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:35.345762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-53358768-5000-4d03-aae5-83fa166da679 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:35.420842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1233/2424] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:35.425437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.491101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8448305c-4c86-424c-b448-932227a31820 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.496674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.497340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.497624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.498466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.499168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.501155 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.511215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:35.630097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1192/2425] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:35 2022] POST /identity/v3/projects => generated 383 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:35.634832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53358768-5000-4d03-aae5-83fa166da679 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.646684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53358768-5000-4d03-aae5-83fa166da679 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.704081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.705281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.705963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.706272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.706549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.707057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:35.707256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.709513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.735064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da403583-ab3f-4781-9207-464f165e2e7a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.749453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.750393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.750748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.751887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] PATH_INFO: `/v3/projects/e15d95c758a1424ca13b4013414d5765` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.753723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e15d95c758a1424ca13b4013414d5765)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.756458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.787764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1234/2426] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:35 2022] POST /identity/v3/users => generated 298 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:35.791524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.801044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebb83fe6-a676-445e-9171-4fa69f99e0e1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.806233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.806831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.807111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.807386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.810559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.812188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.822844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1235/2427] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:35.826952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.837586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2de5f96e-ba98-4e4d-a81a-354b34433fb1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:35.842588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:35.843587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:35.843875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:35.844153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] PATH_INFO: `/v3/projects/6b78d60b8d41407e8f0bd908a4e40d24/users/3c0aa1e3fb6e4a31b6adf8f6b983c330/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:35.859622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b78d60b8d41407e8f0bd908a4e40d24, user_id=3c0aa1e3fb6e4a31b6adf8f6b983c330, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:35.862865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:35.935896 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1236/2428] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:35 2022] PUT /identity/v3/projects/6b78d60b8d41407e8f0bd908a4e40d24/users/3c0aa1e3fb6e4a31b6adf8f6b983c330/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:35.940023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:35.941976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=2,keystone:DELETE=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:35.946342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e15d95c758a1424ca13b4013414d5765', 'request_id': 'req-2c210710-9518-4983-a02f-b3c045fbfb38'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:35.951778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e15d95c758a1424ca13b4013414d5765', 'request_id': 'req-2c210710-9518-4983-a02f-b3c045fbfb38'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:35.958816 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e15d95c758a1424ca13b4013414d5765', 'request_id': 'req-2c210710-9518-4983-a02f-b3c045fbfb38'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.003604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69658386-eacf-464f-a202-6c7bc6d72ede admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:36.020890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] The token cache is being invalidate because project e15d95c758a1424ca13b4013414d5765 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:36.021578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.022278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.024258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1193/2429] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:35 2022] DELETE /identity/v3/projects/e15d95c758a1424ca13b4013414d5765 => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:36.027921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:36.029359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:36.066396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:36.073083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:36.073755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:36.074045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:36.074342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:36.075125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:36.081601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:36.086493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1237/2430] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:36.090580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:36.092294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:36.104512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c210710-9518-4983-a02f-b3c045fbfb38 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:36.105805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8680c4ad-7cb6-4156-b137-cb0ac8e3358e admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:36.110274 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:36.110634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:36.110921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:36.111027 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0276f85-f8c7-410a-9a07-529c1d07d64f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:36.111197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] PATH_INFO: `/v3/users/522daaf5b81e4af1b0b2f4fc58647254` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:36.111884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276f85-f8c7-410a-9a07-529c1d07d64f admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:36.112164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276f85-f8c7-410a-9a07-529c1d07d64f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:36.112661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] RBAC: Authorizing `identity:delete_user(user_id=522daaf5b81e4af1b0b2f4fc58647254)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:36.112769 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0276f85-f8c7-410a-9a07-529c1d07d64f admin admin] PATH_INFO: `/v3/projects/6b78d60b8d41407e8f0bd908a4e40d24/users/3c0aa1e3fb6e4a31b6adf8f6b983c330/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:36.115186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:36.115314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0276f85-f8c7-410a-9a07-529c1d07d64f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6b78d60b8d41407e8f0bd908a4e40d24, user_id=3c0aa1e3fb6e4a31b6adf8f6b983c330, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:36.118119 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0276f85-f8c7-410a-9a07-529c1d07d64f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:36.128432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1238/2431] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:36 2022] PUT /identity/v3/projects/6b78d60b8d41407e8f0bd908a4e40d24/users/3c0aa1e3fb6e4a31b6adf8f6b983c330/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 38 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:36.138540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:36.138822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:36.139117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:36.166850 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] MFA Rules not processed for user `3c0aa1e3fb6e4a31b6adf8f6b983c330`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:36.168064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:36.235292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1239/2432] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:36 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:36.252047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:36.253428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:36.297261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '522daaf5b81e4af1b0b2f4fc58647254'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.304533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '522daaf5b81e4af1b0b2f4fc58647254'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.311878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c55f7e2-4f22-463f-b8dd-43a3dda1851c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:36.315629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:36.316309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:36.320917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:36.320917 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:36.321135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '522daaf5b81e4af1b0b2f4fc58647254'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.321135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '522daaf5b81e4af1b0b2f4fc58647254'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.325972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:36.327589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:36.338051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1240/2433] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:36 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:21:36.399047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '522daaf5b81e4af1b0b2f4fc58647254'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:36.407677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1194/2434] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:36 2022] DELETE /identity/v3/users/522daaf5b81e4af1b0b2f4fc58647254 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:36.546344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:36.555211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:36.566605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-764810b5-8ba0-42f7-b47d-49e3b5f44f79 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:36.627767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:36.628441 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:36.628722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:36.628999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:36.631402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:36.651021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:36.694112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:36.695691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:36.705186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1241/2435] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:36.953905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:36.956039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.032706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:37.050989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e719c3f-6add-49c5-8fe9-3948a077a47f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:37.056371 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:37.057255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.057540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.057815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] PATH_INFO: `/v3/projects/12f497697d5e432388ec196803def7a1` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.059050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12f497697d5e432388ec196803def7a1)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:37.060988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:37.223109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12f497697d5e432388ec196803def7a1', 'request_id': 'req-72a20da3-b829-47b6-8ac2-4a99f6c31664'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.231420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12f497697d5e432388ec196803def7a1', 'request_id': 'req-72a20da3-b829-47b6-8ac2-4a99f6c31664'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.239230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12f497697d5e432388ec196803def7a1', 'request_id': 'req-72a20da3-b829-47b6-8ac2-4a99f6c31664'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.354927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:37.357765 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.373338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] The token cache is being invalidate because project 12f497697d5e432388ec196803def7a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:37.373705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.374519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-72a20da3-b829-47b6-8ac2-4a99f6c31664 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.376565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1195/2436] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:36 2022] DELETE /identity/v3/projects/12f497697d5e432388ec196803def7a1 => generated 0 bytes in 423 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:37.383750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.384110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.387657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.408665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:37.409865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.505820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1196/2437] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:37.506724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:37.507870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46f6f91b-ee79-42a4-a8a5-0ea1ac3d0bf6 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:37.512658 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.527048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8c13a41-201f-4194-9b18-995bf7903189 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:37.536331 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:37.537852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.538234 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.538584 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] PATH_INFO: `/v3/users/6bb19bf199624f87807890954813ea6e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.539908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6bb19bf199624f87807890954813ea6e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:37.541928 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:37.583158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:37.583947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.584344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.584745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.588264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.603259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:37.606094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6f9baf6-0b49-4aae-8287-d937164cd0a0 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:37.618842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1242/2438] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:37 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 265 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:37.620438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.620727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.621009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.652636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:37.653855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.666774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1243/2439] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:37.670991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:37.681436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0ae7c-0287-4f0d-88a3-bae839d0598a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:37.687311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:37.688061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.688442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.688783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.689622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:37.690082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:37.691795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:37.722228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1244/2440] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:37.727427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:37.729780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6bb19bf199624f87807890954813ea6e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.740382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8bba2-16b7-40f1-aeca-6484a0874c1d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:37.745392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6bb19bf199624f87807890954813ea6e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.746628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:37.747307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.761349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.761690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.762481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:37.769697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:37.784957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6bb19bf199624f87807890954813ea6e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.785787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6bb19bf199624f87807890954813ea6e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.876968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:37.907145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-159f93d4-1524-45c2-b271-26f9a9bc7683 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6bb19bf199624f87807890954813ea6e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:37.920277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1197/2441] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:37 2022] DELETE /identity/v3/users/6bb19bf199624f87807890954813ea6e => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:37.922236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1245/2442] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:37 2022] POST /identity/v3/projects => generated 371 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:37.924419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50facae4-51d5-4919-8ca4-f311edb07687 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:37.924714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50facae4-51d5-4919-8ca4-f311edb07687 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:37.925193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50facae4-51d5-4919-8ca4-f311edb07687 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:37.926728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:37.930197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:37.943694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:37.952285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-50facae4-51d5-4919-8ca4-f311edb07687 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:37.953518 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-50facae4-51d5-4919-8ca4-f311edb07687 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:38.012417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12f60f01-d305-4557-ab9f-a5f33361c1a0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:38.017196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:38.017864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.018185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.018467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.019172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:38.021790 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:38.022474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1198/2443] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:38.024292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.024587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.025089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.043624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:38.044845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:38.109553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1199/2444] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:21:38 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:38.110631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.112091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:38.124636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1246/2445] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:37 2022] POST /identity/v3/users => generated 286 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:38.132444 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.135065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:38.250752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7e25d31-8f85-47aa-b4ab-74a33087dfb6 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:38.257077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:38.257849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.258334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.259049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.273487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:38.275231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:38.287748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1200/2446] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:38.288543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9766908-9e5f-4d28-8b16-71bdd46bcaa6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:38.289359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.301418 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:38.301740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3469a699-c816-4c7f-8da6-004468991e1d service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:38.303799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.306336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.306754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.317413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:38.319100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.319839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.320286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.321608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:38.323907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:38.325327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:38.328145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:38.337580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1201/2447] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:38.341897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.346598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1247/2448] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:21:38 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 217 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:21:38.355312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd73af5-31da-43e5-a18e-0380e2c37cba admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:38.361279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c4cd98-1787-4891-97ea-4eca762d04f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:38.362194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4cd98-1787-4891-97ea-4eca762d04f2 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.363062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4cd98-1787-4891-97ea-4eca762d04f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.363178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c4cd98-1787-4891-97ea-4eca762d04f2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.363962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4cd98-1787-4891-97ea-4eca762d04f2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:38.366237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87c4cd98-1787-4891-97ea-4eca762d04f2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:38.381316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1202/2449] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:38.382836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.399703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca5cda49-fdef-46f1-a749-4ae003c6d39e service swift] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:38.412872 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:38.417111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.417111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.417111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] PATH_INFO: `/v3/projects/8b4371de3ffc4d85a6826a9eb942cca3/users/9e66e9c6a4da4a4384a2d9ef54256004/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.433137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b4371de3ffc4d85a6826a9eb942cca3, user_id=9e66e9c6a4da4a4384a2d9ef54256004, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:38.436050 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:38.577456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1248/2450] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:38 2022] PUT /identity/v3/projects/8b4371de3ffc4d85a6826a9eb942cca3/users/9e66e9c6a4da4a4384a2d9ef54256004/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:38.590218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:38.590511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:38.590802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:38.632157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] MFA Rules not processed for user `9e66e9c6a4da4a4384a2d9ef54256004`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:38.633569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:38.757920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:38.827801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1203/2451] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:38 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:38.844946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.846713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:38.894527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:38.895985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:39.003828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:39.011887 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a379ac7b-9e0b-4755-a78c-6fadf1f223a2 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:39.023749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:39.025401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:39.026462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:39.026462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:39.039581 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:39.041034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:39.052892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1249/2452] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:38 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 208 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:39.079987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:39.097580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5a85c6f-6893-4031-a100-05cdb21631b0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:39.101210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-135eb188-9da8-4068-b7a9-3e5a267d9104 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:39.104265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:39.105580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:39.106161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:39.106679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] PATH_INFO: `/v3/projects/e20a68cc2d3e458daba75d61eb10f155` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:39.108325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] RBAC: Authorizing `identity:delete_project(project_id=e20a68cc2d3e458daba75d61eb10f155)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:39.110667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:39.127345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:39.128587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:39.128587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:39.128809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] PATH_INFO: `/v3/users/9e66e9c6a4da4a4384a2d9ef54256004` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:39.133107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9e66e9c6a4da4a4384a2d9ef54256004)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:39.137238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:39.272248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e20a68cc2d3e458daba75d61eb10f155', 'request_id': 'req-68744dd9-66a8-4472-b124-c983ca1f0a8b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.283963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e20a68cc2d3e458daba75d61eb10f155', 'request_id': 'req-68744dd9-66a8-4472-b124-c983ca1f0a8b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.308224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e20a68cc2d3e458daba75d61eb10f155', 'request_id': 'req-68744dd9-66a8-4472-b124-c983ca1f0a8b'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.406120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] The token cache is being invalidate because project e20a68cc2d3e458daba75d61eb10f155 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:39.406565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.407337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.410721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1204/2453] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:38 2022] DELETE /identity/v3/projects/e20a68cc2d3e458daba75d61eb10f155 => generated 0 bytes in 516 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:39.414762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:39.433916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:39.463374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9e66e9c6a4da4a4384a2d9ef54256004'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.480333 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9e66e9c6a4da4a4384a2d9ef54256004'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.492079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9e66e9c6a4da4a4384a2d9ef54256004'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.492970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9e66e9c6a4da4a4384a2d9ef54256004'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.561275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68744dd9-66a8-4472-b124-c983ca1f0a8b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:39.568368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:39.569284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:39.569565 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:39.569839 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] PATH_INFO: `/v3/users/3c0aa1e3fb6e4a31b6adf8f6b983c330` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:39.571113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c0aa1e3fb6e4a31b6adf8f6b983c330)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:39.573793 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:39.574623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ec6c7a37-fb08-47df-a041-2e13464d70f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9e66e9c6a4da4a4384a2d9ef54256004'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.582086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1250/2454] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:39 2022] DELETE /identity/v3/users/9e66e9c6a4da4a4384a2d9ef54256004 => generated 0 bytes in 503 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:39.587776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:39.588126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:39.588462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:39.629273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:39.631360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:39.841962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1251/2455] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:39.852547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c0aa1e3fb6e4a31b6adf8f6b983c330'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.854061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:39.857048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:39.861581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c0aa1e3fb6e4a31b6adf8f6b983c330'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.883708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c0aa1e3fb6e4a31b6adf8f6b983c330'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.884455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c0aa1e3fb6e4a31b6adf8f6b983c330'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.945742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2296b794-5fcc-452c-840f-bfa607ea487d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:39.961183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:39.961183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:39.961183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:39.961183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:39.973832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:39.975812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:39.980897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c0aa1e3fb6e4a31b6adf8f6b983c330'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:39.989114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1205/2456] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:39 2022] DELETE /identity/v3/users/3c0aa1e3fb6e4a31b6adf8f6b983c330 => generated 0 bytes in 575 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:39.992733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1252/2457] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:40.013449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:40.714116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:40.714576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:40.724471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:40.734794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a069590-8d5d-4dba-96ec-5b8dfc0273f1 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:40.811826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:40.813484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:40.872330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:40.874833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:40.874833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:40.874833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] PATH_INFO: `/v3/projects/6b78d60b8d41407e8f0bd908a4e40d24` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:40.877142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6b78d60b8d41407e8f0bd908a4e40d24)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:40.880708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:40.997733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4339f592-5829-465a-af09-fd14e4509465 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.004118 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.005906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.006384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.006670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] PATH_INFO: `/v3/projects/8b4371de3ffc4d85a6826a9eb942cca3` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.008649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b4371de3ffc4d85a6826a9eb942cca3)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.011224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.133542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6b78d60b8d41407e8f0bd908a4e40d24', 'request_id': 'req-4673f2c6-3b53-4947-8381-21c11f949292'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.145123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6b78d60b8d41407e8f0bd908a4e40d24', 'request_id': 'req-4673f2c6-3b53-4947-8381-21c11f949292'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.163789 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6b78d60b8d41407e8f0bd908a4e40d24', 'request_id': 'req-4673f2c6-3b53-4947-8381-21c11f949292'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.174270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b4371de3ffc4d85a6826a9eb942cca3', 'request_id': 'req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.176139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:41.201342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b4371de3ffc4d85a6826a9eb942cca3', 'request_id': 'req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.224065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b4371de3ffc4d85a6826a9eb942cca3', 'request_id': 'req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.262903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] The token cache is being invalidate because project 6b78d60b8d41407e8f0bd908a4e40d24 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:41.263483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.264803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4673f2c6-3b53-4947-8381-21c11f949292 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.268215 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1253/2458] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:40 2022] DELETE /identity/v3/projects/6b78d60b8d41407e8f0bd908a4e40d24 => generated 0 bytes in 556 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:41.278384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888081c8-ded7-40f0-b91d-ec438302717f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.278899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888081c8-ded7-40f0-b91d-ec438302717f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.279463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888081c8-ded7-40f0-b91d-ec438302717f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.311293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-888081c8-ded7-40f0-b91d-ec438302717f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:41.313110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-888081c8-ded7-40f0-b91d-ec438302717f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:41.363673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] The token cache is being invalidate because project 8b4371de3ffc4d85a6826a9eb942cca3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:41.367513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.367513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-6f729a0d-fe36-4fc3-9d87-2b6a983a350c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:41.369406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1206/2459] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:40 2022] DELETE /identity/v3/projects/8b4371de3ffc4d85a6826a9eb942cca3 => generated 0 bytes in 559 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:41.374391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507fc0-0be5-40ea-a04a-712f40efd023 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.374871 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507fc0-0be5-40ea-a04a-712f40efd023 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.375346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd507fc0-0be5-40ea-a04a-712f40efd023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.402077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1254/2460] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:41.409547 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.411176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.411646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.412291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-dd507fc0-0be5-40ea-a04a-712f40efd023 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:41.415464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-dd507fc0-0be5-40ea-a04a-712f40efd023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:41.438581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1207/2461] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:21:41.441288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:41.443381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:41.446766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.447511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.447966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.454630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1255/2462] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:41.463451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:41.474691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:41.478471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:41.479230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b801161-7d24-4017-bb86-4892f76a0425 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.484530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.485380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.485898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.486340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.487231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:41.488130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.488767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1208/2463] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:41.491078 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.496395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:41.512394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf49458-cd75-4b0d-896b-8506a4e7604b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.516537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1256/2464] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:41.522495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:41.535553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd3d5901-e6aa-436b-831c-4c4e8ab3700f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.541126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.541865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.542275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.542652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.543446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.544662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.545831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.545971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.546334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.552415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.552415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:41.552415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.558616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.581045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1209/2465] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:21:41.585985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:41.599677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887d7642-da76-4a85-b6f4-6606aa34cdcd admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.619869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.625085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.625085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.625085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.625085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.628460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.641594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1257/2466] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/projects => generated 375 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:41.645831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:41.743574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1210/2467] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/projects => generated 377 bytes in 159 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:41.747797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:41.778517 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0cb19ca-b892-4a53-a51a-7c360a60eb20 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.860579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3b0fbac-c8e0-443c-b88a-9adc4522cd4c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:41.867036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.867775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.868062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.868343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.869107 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.875485 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.891427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:41.899383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:41.900067 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:41.900352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:41.900632 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:41.901466 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:41.903786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:41.983586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1211/2468] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/users => generated 289 bytes in 236 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:41.987845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.007148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea385902-c1bd-4921-bc57-4d736645001b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.012887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.013641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.014023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.014552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.054093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.054093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.055148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1258/2469] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:41 2022] POST /identity/v3/users => generated 288 bytes in 384 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:21:42.055329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1212/2470] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:41 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:42.055329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.055488 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.070372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f610b7f-ebca-42c4-859e-980950de6a31 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.073824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f585f3ac-78be-4761-893d-f86bbe8f2a74 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.075904 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.076695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.076976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.077265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.078413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.080172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.093122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.093852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1259/2471] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:42.094433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.094770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.095089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.095892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.099807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.118472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1213/2472] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 63 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:42.138255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.144774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.158590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fab355b3-7da8-4572-b27b-d7af910bf2f3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.167449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.172417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.172417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.172417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.172417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.172417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.175337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2ecb44-1730-4d10-b1cb-d3fcf72a36ad admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.186604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a209cdf4-7d04-4441-8e23-e091e551726a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.187528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209cdf4-7d04-4441-8e23-e091e551726a admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.187817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209cdf4-7d04-4441-8e23-e091e551726a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.188099 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a209cdf4-7d04-4441-8e23-e091e551726a admin admin] PATH_INFO: `/v3/projects/b2a371303d224681b60684724b162976/users/61a3b44a0d2c4700b7fd0f0d3bab838e/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.194779 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1260/2473] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:42 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:42.196201 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.209227 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae9d7d8-c099-4f69-9b4a-ef71f493fe85 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.214956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37a64c98-dd9d-4090-9e5c-4f7d800e9f4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.216306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64c98-dd9d-4090-9e5c-4f7d800e9f4c admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.216795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64c98-dd9d-4090-9e5c-4f7d800e9f4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.217148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37a64c98-dd9d-4090-9e5c-4f7d800e9f4c admin admin] PATH_INFO: `/v3/projects/7c7d49c27f2042f8b6844d8adb2401f9/users/41ba1891f89b45ceab7a605cd0429642/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.223422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209cdf4-7d04-4441-8e23-e091e551726a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b2a371303d224681b60684724b162976, user_id=61a3b44a0d2c4700b7fd0f0d3bab838e, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.228790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a209cdf4-7d04-4441-8e23-e091e551726a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.239307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64c98-dd9d-4090-9e5c-4f7d800e9f4c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7c7d49c27f2042f8b6844d8adb2401f9, user_id=41ba1891f89b45ceab7a605cd0429642, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.243385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37a64c98-dd9d-4090-9e5c-4f7d800e9f4c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.323733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1214/2474] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:42 2022] PUT /identity/v3/projects/b2a371303d224681b60684724b162976/users/61a3b44a0d2c4700b7fd0f0d3bab838e/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:42.332325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.332671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.335643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.348124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1261/2475] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:42 2022] PUT /identity/v3/projects/7c7d49c27f2042f8b6844d8adb2401f9/users/41ba1891f89b45ceab7a605cd0429642/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:42.364303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.364889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.365540 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.402709 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] MFA Rules not processed for user `61a3b44a0d2c4700b7fd0f0d3bab838e`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:42.404043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] MFA Rules not processed for user `41ba1891f89b45ceab7a605cd0429642`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:42.404335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:42.405330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:42.461448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=2,keystone:INSERT=6 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:42.500866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1262/2476] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:42 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:42.521573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.525523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:42.527037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1215/2477] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:42 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:42.540000 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:42.541429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:42.594181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=5,keystone:SELECT=95 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:42.628315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6974963-5a72-4ae1-af59-c2721ca2302d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.629335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c87c5a-6cf1-4f20-97d3-7eba1163c48a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:42.635676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fc6cd04-b4d8-4ab4-ba08-d14f179d1f05 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.636360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:42.636513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6cd04-b4d8-4ab4-ba08-d14f179d1f05 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.637044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6cd04-b4d8-4ab4-ba08-d14f179d1f05 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.637572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fc6cd04-b4d8-4ab4-ba08-d14f179d1f05 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.638047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:42.638359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:42.638724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:42.649160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.649730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6cd04-b4d8-4ab4-ba08-d14f179d1f05 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:42.650732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.651663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fc6cd04-b4d8-4ab4-ba08-d14f179d1f05 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:42.663051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1216/2478] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:42 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:42.663303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1263/2479] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:42 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:47.844978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:47.931137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dd4134-a097-4a8a-829f-d2be4adb738d service glance] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:47.936262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:47.937214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:47.937542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:47.937819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] PATH_INFO: `/v3/users/41ba1891f89b45ceab7a605cd0429642` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:47.939054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] RBAC: Authorizing `identity:delete_user(user_id=41ba1891f89b45ceab7a605cd0429642)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:47.943132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:48.165724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41ba1891f89b45ceab7a605cd0429642'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:48.179542 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41ba1891f89b45ceab7a605cd0429642'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:48.192956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:48.196320 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41ba1891f89b45ceab7a605cd0429642'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:48.197574 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41ba1891f89b45ceab7a605cd0429642'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:48.289442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41ba1891f89b45ceab7a605cd0429642'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:48.296375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1217/2480] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:47 2022] DELETE /identity/v3/users/41ba1891f89b45ceab7a605cd0429642 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:48.304492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:48.305073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:48.305532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:48.324181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:48.325562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:48.408344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1264/2481] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:48.420083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:48.421535 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:48.499961 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e89a82f4-a5a9-40f9-a666-3cfc9f69be16 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:48.503804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2bb703-6afc-4b30-aa5c-1a517994f7c4 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:48.504460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bb703-6afc-4b30-aa5c-1a517994f7c4 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:48.504894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bb703-6afc-4b30-aa5c-1a517994f7c4 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:48.505025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2bb703-6afc-4b30-aa5c-1a517994f7c4 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:48.532364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bb703-6afc-4b30-aa5c-1a517994f7c4 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:48.535716 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2bb703-6afc-4b30-aa5c-1a517994f7c4 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:48.550298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1218/2482] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:49.477650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:49.479200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:49.515212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d26c65c-3ae7-47a7-973e-fe33e7b12a1b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:49.531996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:49.532941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:49.533222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:49.533497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] PATH_INFO: `/v3/projects/7c7d49c27f2042f8b6844d8adb2401f9` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:49.536759 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7c7d49c27f2042f8b6844d8adb2401f9)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:49.539492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:49.729781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7c7d49c27f2042f8b6844d8adb2401f9', 'request_id': 'req-da4160f6-ba70-4ca2-a2a8-a52255ecd232'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:49.739242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7c7d49c27f2042f8b6844d8adb2401f9', 'request_id': 'req-da4160f6-ba70-4ca2-a2a8-a52255ecd232'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:49.751783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7c7d49c27f2042f8b6844d8adb2401f9', 'request_id': 'req-da4160f6-ba70-4ca2-a2a8-a52255ecd232'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:49.897703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:49.901815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] The token cache is being invalidate because project 7c7d49c27f2042f8b6844d8adb2401f9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:21:49.902144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:49.905206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-da4160f6-ba70-4ca2-a2a8-a52255ecd232 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:49.910802 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1265/2483] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:21:49 2022] DELETE /identity/v3/projects/7c7d49c27f2042f8b6844d8adb2401f9 => generated 0 bytes in 431 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:49.914910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:49.915783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:49.915783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:49.985626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:49.985626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:50.129520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1219/2484] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:50.138607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.138969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.139245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.181060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:50.182324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:50.195328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1266/2485] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:50.197367 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:50.213113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2f7ed26-8156-4b7c-9a0a-824929ee993b None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:50.233202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:50.236312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.236312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.236312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.236312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:21:50.236312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:50.237970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:50.270671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1220/2486] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:21:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 66 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:21:50.270908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:50.285504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2feb18ad-8a1b-43e7-aa8a-5a88cbb03362 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:50.320787 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:50.322587 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.329930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.329930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.329930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:50.333436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:50.481172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1267/2487] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:50 2022] POST /identity/v3/projects => generated 375 bytes in 213 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:50.481974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:50.496361 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4695cba3-9ed6-4eeb-8bea-9cc51bb0ff3b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:50.694701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:50.695753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.696022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.696298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.704158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:50.716302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:50.816862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:50.819324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:50.833534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1221/2488] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:50 2022] POST /identity/v3/users => generated 288 bytes in 352 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:50.837750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:50.852144 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbca423-6ab4-4146-8ce3-0d7f60a675ca admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:50.858529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:50.859963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.860348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.860785 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.861643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:50.863691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:50.866922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=2,keystone:SELECT=94,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:50.880247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1222/2489] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:50.884555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:50.896220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6b7af64-1b3b-4bd0-94c0-cf1b9628b747 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:50.931636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:50.932328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.932613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.932892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.937799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:50.948878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:50.951376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18998ff-fa91-42ac-ad86-62a9fe4f5eda admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:50.975502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:50.980311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:50.980742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:50.981129 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:50.983259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:50.987675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1223/2490] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:50 2022] GET /identity/v3/roles => generated 1420 bytes in 103 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:50.988551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:51.002092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be870c34-422f-45f4-a4a8-1e407843c508 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:51.017343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:51.018210 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:51.018504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:51.018768 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] PATH_INFO: `/v3/projects/de2c6bd741d84212a791423e6d7bc690/users/e030e98b108b4f26bc65831498475ddd/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:51.042174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=de2c6bd741d84212a791423e6d7bc690, user_id=e030e98b108b4f26bc65831498475ddd, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:51.042389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:51.099115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:51.100636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afb2f9c3-1cfc-4a87-84d5-1d4cdca0823b service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:51.114074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1268/2491] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:50 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 296 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:51.162601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1224/2492] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:50 2022] PUT /identity/v3/projects/de2c6bd741d84212a791423e6d7bc690/users/e030e98b108b4f26bc65831498475ddd/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:51.173545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:51.173937 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:51.177356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:51.255145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] MFA Rules not processed for user `e030e98b108b4f26bc65831498475ddd`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:51.262943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:51.365299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1269/2493] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:51.369956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:51.452288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d49ab33-6c7e-49ed-85d5-34907843e2b6 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:51.457992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:51.459069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:51.459621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:51.460382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:51.461419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:51.463921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:51.810455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1225/2494] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:51 2022] POST /identity/v3/projects => generated 375 bytes in 441 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:51.816128 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:51.829423 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:51.838386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce65159-3673-40e4-b9f1-e67e541feffa None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:51.914489 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:51.915163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:51.915471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:51.915749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:51.916440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:51.918394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:52.036260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1270/2495] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:51 2022] POST /identity/v3/users => generated 288 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:52.040889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:52.065608 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9020a52-7a39-4bac-94e4-9ddd299b410c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:52.072488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:52.073358 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:52.073995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:52.074486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:52.075232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:52.076920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:52.089158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1226/2496] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:21:52.093187 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:52.105532 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-335647b6-ac58-4a54-b8f7-b1c4a1c34a19 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:52.122812 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2df27c4-48e6-4757-9c5c-6ca206a6b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:52.123502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df27c4-48e6-4757-9c5c-6ca206a6b8e1 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:52.131440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df27c4-48e6-4757-9c5c-6ca206a6b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:52.131440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2df27c4-48e6-4757-9c5c-6ca206a6b8e1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:52.131440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df27c4-48e6-4757-9c5c-6ca206a6b8e1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:52.131440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2df27c4-48e6-4757-9c5c-6ca206a6b8e1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:52.148742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1271/2497] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:52 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:52.152684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:52.166424 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-486f501d-8bfe-420e-9bc2-d7bea95e5149 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:52.175549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:52.177567 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:52.178403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:52.178679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] PATH_INFO: `/v3/projects/b48bb9e33347454aba7492b8169e8c2c/users/78d4c3b4f9a54e3db6f358eb76b64d57/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:52.198732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b48bb9e33347454aba7492b8169e8c2c, user_id=78d4c3b4f9a54e3db6f358eb76b64d57, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:52.201869 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:52.340710 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1227/2498] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:52 2022] PUT /identity/v3/projects/b48bb9e33347454aba7492b8169e8c2c/users/78d4c3b4f9a54e3db6f358eb76b64d57/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:21:52.340900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:52.340900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:52.340900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:52.379464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] MFA Rules not processed for user `78d4c3b4f9a54e3db6f358eb76b64d57`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:52.381259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:52.471908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1272/2499] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:52 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:52.476098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:52.576398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a3d31b-9127-4090-873e-0a66cfb96bd1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:52.583195 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:52.584404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:52.584694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:52.584973 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:52.586552 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:52.588508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:52.614912 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:52.813200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1228/2500] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:21:52 2022] POST /identity/v3/projects => generated 375 bytes in 335 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:52.815084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:52.835398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7d01767-f3a5-41e6-aada-e5b0e99dbe04 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:52.921115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:52.921860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:52.922188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:52.922473 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:52.923552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:52.925289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:53.010135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:53.019784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1273/2501] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:21:52 2022] POST /identity/v3/users => generated 294 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:21:53.020478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:53.032285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-570262f5-5cdc-40b7-ac4a-a39d12d05f9a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:53.037943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:53.038711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:53.039052 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:53.039337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:53.040076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:53.041780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:53.054067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1229/2502] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:53.058299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:53.073368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5e43254-3ff3-4940-b8d9-a4cadf5901bb admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:53.079899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:53.080926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:53.081398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:53.081717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] PATH_INFO: `/v3/projects/6a2cb9a878454a8e893c072b24e7422c/users/13e5e898b1564339bcf29a687cd3b94e/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:53.097369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2cb9a878454a8e893c072b24e7422c, user_id=13e5e898b1564339bcf29a687cd3b94e, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:53.100660 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:53.165960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1274/2503] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:53 2022] PUT /identity/v3/projects/6a2cb9a878454a8e893c072b24e7422c/users/13e5e898b1564339bcf29a687cd3b94e/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:53.170218 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:53.181270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a81e14f-f894-429d-9dda-30aecfdadef7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:53.263516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13697d6c-6c7e-471d-b7f0-d15459a16be6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:53.264197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697d6c-6c7e-471d-b7f0-d15459a16be6 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:53.264483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697d6c-6c7e-471d-b7f0-d15459a16be6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:53.264937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13697d6c-6c7e-471d-b7f0-d15459a16be6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:53.265814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13697d6c-6c7e-471d-b7f0-d15459a16be6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:53.267661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13697d6c-6c7e-471d-b7f0-d15459a16be6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:53.288240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1230/2504] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:21:53 2022] GET /identity/v3/roles => generated 1420 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:21:53.292704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:53.306105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3727d46-6e9d-4a37-82c6-c2286662f75f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:53.311326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:53.312586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:53.312873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:53.313151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] PATH_INFO: `/v3/projects/6a2cb9a878454a8e893c072b24e7422c/users/13e5e898b1564339bcf29a687cd3b94e/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:53.316747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6a2cb9a878454a8e893c072b24e7422c, user_id=13e5e898b1564339bcf29a687cd3b94e, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:53.322840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:53.338330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1275/2505] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:21:53 2022] PUT /identity/v3/projects/6a2cb9a878454a8e893c072b24e7422c/users/13e5e898b1564339bcf29a687cd3b94e/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:53.349592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:53.349885 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:53.350193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:53.380787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] MFA Rules not processed for user `13e5e898b1564339bcf29a687cd3b94e`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:53.383104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:53.467012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1231/2506] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:53 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:53.481844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:53.489646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:53.557392 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bf55e4c-8ee1-427c-888f-7c4ae1e8385f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:53.562191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:53.568818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:53.568818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:53.568818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:53.639279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:53.640778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:53.651724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1276/2507] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:53 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:55.802910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:55.806554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:55.816151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-521cdeac-b7bf-4e15-94be-66d912a4b2e4 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:55.819696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:55.820330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:55.820613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:55.820891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:55.878344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:55.879860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:55.889240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1232/2508] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:55 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:57.383063 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:57.384616 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:57.518704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6f56b92-3e2a-4ea5-9b21-024e564ea77c service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:57.528510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:57.528510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:57.528510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:57.528510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:57.529968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:57.536394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:57.548281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:57.552610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:21:57.553235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1241d53-4224-413e-87d2-407a1e261b10 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:57.558159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:57.558802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:57.559267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:57.559783 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:57.570978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:57.572603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:57.584194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1233/2509] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:57 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:57.602826 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:57.604709 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:57.634238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1277/2510] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:57 2022] GET /identity/v3/auth/tokens => generated 3256 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:58.203548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:58.259185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fe5c1da-583b-468d-a9b9-5de3bd9be6c3 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:58.263165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:58.263893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:58.264246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:58.264532 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:58.266454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:58.330185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:58.331727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05abdbd-1195-484a-8a49-5e3fe6200bba service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:58.342122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1234/2511] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:21:59.192566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:59.194114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:59.207075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-365601ec-7cf0-4028-84eb-702e50d10cb9 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:59.211591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:59.212448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:59.212733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:59.213011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] PATH_INFO: `/v3/users/61a3b44a0d2c4700b7fd0f0d3bab838e` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:59.218893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] RBAC: Authorizing `identity:delete_user(user_id=61a3b44a0d2c4700b7fd0f0d3bab838e)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:59.218893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:59.405620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '61a3b44a0d2c4700b7fd0f0d3bab838e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:59.422045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '61a3b44a0d2c4700b7fd0f0d3bab838e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:59.444197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '61a3b44a0d2c4700b7fd0f0d3bab838e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:59.445597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '61a3b44a0d2c4700b7fd0f0d3bab838e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:59.528443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '61a3b44a0d2c4700b7fd0f0d3bab838e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:21:59.542680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1278/2512] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:21:59 2022] DELETE /identity/v3/users/61a3b44a0d2c4700b7fd0f0d3bab838e => generated 0 bytes in 350 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:21:59.549592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572aae-8ba2-44a5-a924-abca90aaae12 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:59.550966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572aae-8ba2-44a5-a924-abca90aaae12 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:59.551749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1572aae-8ba2-44a5-a924-abca90aaae12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:59.572915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d1572aae-8ba2-44a5-a924-abca90aaae12 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:21:59.574397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d1572aae-8ba2-44a5-a924-abca90aaae12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:59.656321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1235/2513] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:21:59.663044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:21:59.665432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:21:59.733397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c224ea9b-cb2b-4633-b305-e1595d5123cc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:21:59.737481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae018aa-6e63-4b89-addf-9ebaa6c24086 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:21:59.738158 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae018aa-6e63-4b89-addf-9ebaa6c24086 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:21:59.738450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae018aa-6e63-4b89-addf-9ebaa6c24086 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:21:59.738791 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae018aa-6e63-4b89-addf-9ebaa6c24086 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:21:59.748697 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae018aa-6e63-4b89-addf-9ebaa6c24086 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:21:59.750223 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aae018aa-6e63-4b89-addf-9ebaa6c24086 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:21:59.760932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1279/2514] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:21:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:00.006068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b61a-d745-42a7-99f8-56aca915ebf0 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.006527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b61a-d745-42a7-99f8-56aca915ebf0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.007408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e267b61a-d745-42a7-99f8-56aca915ebf0 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.009045 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1236/2515] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:22:00 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:22:00.023238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.024744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.025579 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.058596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:00.059686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.106051 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:00.158524 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1280/2516] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:00.174702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b61a-d745-42a7-99f8-56aca915ebf0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.177344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e267b61a-d745-42a7-99f8-56aca915ebf0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.232337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:00.245752 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e267b61a-d745-42a7-99f8-56aca915ebf0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:00.249743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e3dfbc3-d2aa-4d2a-baff-977e0f127eb8 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:00.250684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dfbc3-d2aa-4d2a-baff-977e0f127eb8 service glance] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.251125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dfbc3-d2aa-4d2a-baff-977e0f127eb8 service glance] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.251412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e3dfbc3-d2aa-4d2a-baff-977e0f127eb8 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.263770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dfbc3-d2aa-4d2a-baff-977e0f127eb8 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:00.265225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e3dfbc3-d2aa-4d2a-baff-977e0f127eb8 service glance] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:00.277559 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1237/2517] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:00.326266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.327829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.344766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f6f8013-2c00-4f84-bcf7-c913b65fd251 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:00.364023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:00.365388 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.365998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.367412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] PATH_INFO: `/v3/projects/b2a371303d224681b60684724b162976` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.369390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] RBAC: Authorizing `identity:delete_project(project_id=b2a371303d224681b60684724b162976)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:00.372432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:00.471867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b2a371303d224681b60684724b162976', 'request_id': 'req-ab47dd91-911b-4eba-afee-182a6d6ab5db'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:00.481226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b2a371303d224681b60684724b162976', 'request_id': 'req-ab47dd91-911b-4eba-afee-182a6d6ab5db'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:00.492702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b2a371303d224681b60684724b162976', 'request_id': 'req-ab47dd91-911b-4eba-afee-182a6d6ab5db'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:00.507780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba638c-f1b7-486c-9866-66d3e1245b71 None None] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.507907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba638c-f1b7-486c-9866-66d3e1245b71 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.508625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48ba638c-f1b7-486c-9866-66d3e1245b71 None None] PATH_INFO: `/` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.513073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1238/2518] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:22:00 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:22:00.518534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.518823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.519103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.539627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] MFA Rules not processed for user `6f78d8aba8a94343b33000d45c22fae8`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:00.540843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.573288 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] The token cache is being invalidate because project b2a371303d224681b60684724b162976 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:00.573810 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:00.575451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ab47dd91-911b-4eba-afee-182a6d6ab5db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:00.581074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1281/2519] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:00 2022] DELETE /identity/v3/projects/b2a371303d224681b60684724b162976 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:00.583002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.593087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.593471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.602402 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1239/2520] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:00.614484 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:00.615372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.615900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.617721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.629057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d795297-cfcb-4a66-af28-ab6e595d4bce None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:00.632867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8efce2ba-16a6-4e3f-8825-27dcdf5221a5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:00.633540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce2ba-16a6-4e3f-8825-27dcdf5221a5 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.633819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce2ba-16a6-4e3f-8825-27dcdf5221a5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.634120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8efce2ba-16a6-4e3f-8825-27dcdf5221a5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.641972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efce2ba-16a6-4e3f-8825-27dcdf5221a5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:00.643447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8efce2ba-16a6-4e3f-8825-27dcdf5221a5 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:00.653494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1240/2521] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:00 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:22:00.681710 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1282/2522] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:00.689394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.689662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.690270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.718891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:00.718891 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.731834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1241/2523] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:00.733222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.744853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e51fc821-7908-4a5f-bdc1-234e9365175a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:00.755069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:00.755585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.756072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.756350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.757240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:00.757479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:00.759112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417fe72-e86d-4058-afe7-0795b748b719 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:00.785000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1283/2524] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:22:00.785875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.798500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b1b134e-210e-4d7f-80cd-4f13f70186ba None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:00.805168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:00.806179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.806842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.807337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.808501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:00.811120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:00.813263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fbaee-7d51-4c42-9a0b-260752ac844b None None] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.813555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fbaee-7d51-4c42-9a0b-260752ac844b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.813878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9fbaee-7d51-4c42-9a0b-260752ac844b None None] PATH_INFO: `/` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.817110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1284/2525] 10.222.0.20 () {54 vars in 921 bytes} [Wed Jul 6 17:22:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Jul 06 17:22:00.829259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:00.829591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:00.829819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:00.852876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] MFA Rules not processed for user `45e533c543494ad2a9a294458fa79d14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:00.854173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:00.903603 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:00.933899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1242/2526] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/projects => generated 383 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:00.939125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.965847 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1285/2527] 10.222.0.20 () {58 vars in 1018 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:00.982249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:00.985561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:01.003804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e06e98e-d2bc-46e7-b57f-b966d8c60978 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:01.078070 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a7d3723-9e51-4f7b-92f0-be1b5844c21b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:01.093983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:01.098136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.098136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.098136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.098136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:01.098136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:01.101265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:01.102162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.102437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.102768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.200265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1243/2528] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:00 2022] POST /identity/v3/users => generated 292 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:01.204301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:01.207260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:01.208999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:01.215660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a2a22d8-0088-40f8-9f78-51eb56c5b622 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:01.220764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:01.221431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.221719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.221931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1286/2529] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:00 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 241 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:22:01.222081 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.222764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:01.225044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:01.247049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1244/2530] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:22:01.250993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:01.261772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1594b483-0a70-4032-9c23-28513937cf37 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:01.266988 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23a83f61-6f6e-4082-8421-add2405ea386 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:01.271555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a83f61-6f6e-4082-8421-add2405ea386 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.271555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a83f61-6f6e-4082-8421-add2405ea386 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.271555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23a83f61-6f6e-4082-8421-add2405ea386 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.271555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a83f61-6f6e-4082-8421-add2405ea386 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:01.271555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23a83f61-6f6e-4082-8421-add2405ea386 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:01.282743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1287/2531] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:01 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:22:01.287531 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:01.300610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6f3786-a390-4d64-acc9-ac278a07ba87 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:01.307737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:01.308534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.308818 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.309213 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] PATH_INFO: `/v3/projects/5915d4ce62e946e59053027d6ebc8026/users/cdc9e76e076f42ac847ada1a823d807d/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.346113 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5915d4ce62e946e59053027d6ebc8026, user_id=cdc9e76e076f42ac847ada1a823d807d, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:01.375755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:01.472001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1245/2532] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:01 2022] PUT /identity/v3/projects/5915d4ce62e946e59053027d6ebc8026/users/cdc9e76e076f42ac847ada1a823d807d/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:01.484952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.485443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.485825 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.517732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] MFA Rules not processed for user `cdc9e76e076f42ac847ada1a823d807d`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:01.519110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:01.564348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:01.591474 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1288/2533] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:01 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:01.602168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:01.603892 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:01.613906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:01.660022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61eb9130-af0e-4f41-b3b7-e084885d5650 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:01.664314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:01.664962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:01.665247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:01.665526 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:01.673766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:01.675388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:01.685302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1246/2534] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:01 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:02.313060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:02.315795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:02.399914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a18b2c-ec98-4ad5-b744-d005d2e9a87e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:02.406888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:02.407594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:02.407933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:02.408279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:02.410416 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:02.425505 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:02.427503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:02.440478 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1289/2535] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:02 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:02.467317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:02.469822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:02.493821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:02.499412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:02.630848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-579f5f9b-c1d8-4139-acfa-75cc36371d22 service placement] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:02.644727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:02.646174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:02.646410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:02.647124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] PATH_INFO: `/v3/users/e030e98b108b4f26bc65831498475ddd` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:02.650854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e030e98b108b4f26bc65831498475ddd)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:02.652231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a87b2703-ec00-40f5-8ef8-e4544ab08bd7 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:02.655552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:02.667221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:02.668125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:02.668417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:02.668695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] PATH_INFO: `/v3/users/9d3ca58b09634edc9e093d9d9eb0ee3f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:02.669985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d3ca58b09634edc9e093d9d9eb0ee3f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:02.672150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:02.824162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e030e98b108b4f26bc65831498475ddd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.837157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e030e98b108b4f26bc65831498475ddd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.843547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d3ca58b09634edc9e093d9d9eb0ee3f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.844390 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e030e98b108b4f26bc65831498475ddd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.845231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e030e98b108b4f26bc65831498475ddd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.847344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:02.852662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d3ca58b09634edc9e093d9d9eb0ee3f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.866175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d3ca58b09634edc9e093d9d9eb0ee3f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.866967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d3ca58b09634edc9e093d9d9eb0ee3f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.915359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4f455e09-8d13-4e0b-b889-f5ced0c50741 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e030e98b108b4f26bc65831498475ddd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.921924 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1290/2536] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:02 2022] DELETE /identity/v3/users/e030e98b108b4f26bc65831498475ddd => generated 0 bytes in 429 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:02.926639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:02.926947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:02.927563 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:02.945503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:02.946729 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:02.980307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d3ca58b09634edc9e093d9d9eb0ee3f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:02.986910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1247/2537] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:02 2022] DELETE /identity/v3/users/9d3ca58b09634edc9e093d9d9eb0ee3f => generated 0 bytes in 520 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:03.013716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1291/2538] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:03.026091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:03.027761 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:03.063741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:03.094995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c091a087-283c-4095-b07b-d757fd344ead admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:03.099087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48efe63b-6087-46a0-a18a-dc50de0e3746 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:03.100028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efe63b-6087-46a0-a18a-dc50de0e3746 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.100261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efe63b-6087-46a0-a18a-dc50de0e3746 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.100673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48efe63b-6087-46a0-a18a-dc50de0e3746 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.172660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efe63b-6087-46a0-a18a-dc50de0e3746 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:03.174154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48efe63b-6087-46a0-a18a-dc50de0e3746 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:03.185007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1248/2539] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:03.256435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:03.258499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:03.271862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13ea73f3-fcd3-4d56-8388-871ca04900c2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:03.276898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:03.277831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.278182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.283533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] PATH_INFO: `/v3/projects/da331fc862d44b68b52cc0b7d91d9c92` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.283533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da331fc862d44b68b52cc0b7d91d9c92)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:03.283533 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:03.407406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da331fc862d44b68b52cc0b7d91d9c92', 'request_id': 'req-5c489a44-59c4-47c4-a81a-24f2f2c74419'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:03.413455 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da331fc862d44b68b52cc0b7d91d9c92', 'request_id': 'req-5c489a44-59c4-47c4-a81a-24f2f2c74419'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:03.420138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da331fc862d44b68b52cc0b7d91d9c92', 'request_id': 'req-5c489a44-59c4-47c4-a81a-24f2f2c74419'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:03.515497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] The token cache is being invalidate because project da331fc862d44b68b52cc0b7d91d9c92 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:03.516172 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:03.516772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5c489a44-59c4-47c4-a81a-24f2f2c74419 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:03.518611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1292/2540] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:03 2022] DELETE /identity/v3/projects/da331fc862d44b68b52cc0b7d91d9c92 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:03.523606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.524018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.524392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.552727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:03.552727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:03.615481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1249/2541] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:03.624120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.625184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.625670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.650601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:03.651841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:03.660672 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1293/2542] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 38 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:03.665555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:03.677884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47894e67-b74e-4f7d-b748-6ad8d4b27afa None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:03.683688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:03.684360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.684671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.685112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.685851 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:03.686193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:03.687876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8b4fca8-865c-4c5b-91ef-e0de4878ffa9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:03.701717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1250/2543] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:22:03.707304 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:03.720742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cc2765a-2088-48d9-85a4-3f98c883cfb8 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:03.728462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:03.729300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.729735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.730814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.732054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:03.734584 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:03.791668 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.792064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.792446 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.813219 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:03.814695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:03.846074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1294/2544] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:03 2022] POST /identity/v3/projects => generated 363 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:03.847545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:03.849929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:03.887927 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1251/2545] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:22:03 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:03.888854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:03.915278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb432c75-4cc6-4dc3-96fd-6a535cd8b961 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:03.917163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=3,keystone:DELETE=8,keystone:SELECT=89 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:03.923314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:03.932861 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3c8fea-1718-4179-a242-559ba8856d76 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:03.938206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:03.939073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.939355 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.939631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] PATH_INFO: `/v3/projects/de2c6bd741d84212a791423e6d7bc690` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.940879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] RBAC: Authorizing `identity:delete_project(project_id=de2c6bd741d84212a791423e6d7bc690)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:03.942830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:03.974101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:03.974772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:03.975054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:03.975329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:03.976678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:03.978685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.085572 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'de2c6bd741d84212a791423e6d7bc690', 'request_id': 'req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.091456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'de2c6bd741d84212a791423e6d7bc690', 'request_id': 'req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.094599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1252/2546] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:03 2022] POST /identity/v3/users => generated 282 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:04.095426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.097139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:04.098477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'de2c6bd741d84212a791423e6d7bc690', 'request_id': 'req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.166580 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45a6ecfb-74be-4ed8-8a4d-bffbaedcebc5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:04.187292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] The token cache is being invalidate because project de2c6bd741d84212a791423e6d7bc690 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:04.187585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.188236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.189957 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1295/2547] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:03 2022] DELETE /identity/v3/projects/de2c6bd741d84212a791423e6d7bc690 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:04.190841 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.192139 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:04.231926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:04.232672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.232957 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.233238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.235098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:04.258711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e4a7417-7853-4bd4-8455-2fe1f446dd9b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:04.268678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:04.269786 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.271559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.271559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.271559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:04.274242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.288987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1296/2548] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 98 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:04.288987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.288987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:04.298708 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:04.305238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb14872-25bc-474f-b798-1d952d294232 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:04.309814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:04.310705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.310985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.311371 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] PATH_INFO: `/v3/users/78d4c3b4f9a54e3db6f358eb76b64d57` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.312474 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:04.312602 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=78d4c3b4f9a54e3db6f358eb76b64d57)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:04.314100 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.314485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.324026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1253/2549] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:22:04 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 229 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:22:04.324909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.336073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ab94c6-fded-4d5b-a4bd-d3e2544d2d8d service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:04.342867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:04.343568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.343846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.344125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.344894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:04.346631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.357192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1254/2550] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:04.361305 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.371344 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f0f8b89-6165-4f4c-8978-c79f7648d591 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:04.376191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de8cd4c-c5a2-4bfa-89b0-3c2bd5db228f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:04.377076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cd4c-c5a2-4bfa-89b0-3c2bd5db228f admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.382368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cd4c-c5a2-4bfa-89b0-3c2bd5db228f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.382368 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de8cd4c-c5a2-4bfa-89b0-3c2bd5db228f admin admin] PATH_INFO: `/v3/projects/ee413682d29246ac8cfc20a04f7a22bf/users/cecbd75689f548078971c06387321797/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.392395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8cd4c-c5a2-4bfa-89b0-3c2bd5db228f admin admin] RBAC: Authorizing `identity:create_grant(project_id=ee413682d29246ac8cfc20a04f7a22bf, user_id=cecbd75689f548078971c06387321797, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:04.395097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9de8cd4c-c5a2-4bfa-89b0-3c2bd5db228f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.494136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1255/2551] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:04 2022] PUT /identity/v3/projects/ee413682d29246ac8cfc20a04f7a22bf/users/cecbd75689f548078971c06387321797/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:04.505415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.505763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.505988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.529683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '78d4c3b4f9a54e3db6f358eb76b64d57'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.565915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '78d4c3b4f9a54e3db6f358eb76b64d57'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.573843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] MFA Rules not processed for user `cecbd75689f548078971c06387321797`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:04.575453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:04.580249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '78d4c3b4f9a54e3db6f358eb76b64d57'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.581500 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '78d4c3b4f9a54e3db6f358eb76b64d57'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.649627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '78d4c3b4f9a54e3db6f358eb76b64d57'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:04.652516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1256/2552] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:04 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:04.657206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.659591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1297/2553] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:04 2022] DELETE /identity/v3/users/78d4c3b4f9a54e3db6f358eb76b64d57 => generated 0 bytes in 370 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:04.743689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:04.779826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bee4a205-5d1e-4e87-8f61-4eeaff47ce83 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:04.854674 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:04.855237 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:04.855596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:04.855889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:04.856842 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:04.858900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:04.947609 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:04.988553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1257/2554] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:04 2022] POST /identity/v3/projects => generated 363 bytes in 332 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:22:04.988881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:04.990438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:05.018297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa33460c-8399-4a08-a6ff-4a5ec7196ab2 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.156615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.157312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.157591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.157870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.158605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.160795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.234663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1298/2555] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:04 2022] POST /identity/v3/users => generated 288 bytes in 246 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:05.238776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.253321 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-544a15c6-d1f0-4d09-927d-55afde7db89a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.256539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.259604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:05.271019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.275231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.277801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.277801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.277801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.281513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.301193 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0151b232-fcec-4435-909b-153588db3e53 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.314405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.315270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.315553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.315830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] PATH_INFO: `/v3/projects/b48bb9e33347454aba7492b8169e8c2c` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.318781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] RBAC: Authorizing `identity:delete_project(project_id=b48bb9e33347454aba7492b8169e8c2c)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.321661 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.333250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1258/2556] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:05.338334 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.352253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0043e800-c0ac-4e4e-848f-aafc6885f5f1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.359190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.361363 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.361648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.362206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] PATH_INFO: `/v3/projects/ed80e30d3bc84b3c937f210536ef3fc9/users/7188f112809a46a490a0833e02b1ea0a/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.380735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed80e30d3bc84b3c937f210536ef3fc9, user_id=7188f112809a46a490a0833e02b1ea0a, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.384705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.499256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1259/2557] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:05 2022] PUT /identity/v3/projects/ed80e30d3bc84b3c937f210536ef3fc9/users/7188f112809a46a490a0833e02b1ea0a/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:05.505423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.523127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b48bb9e33347454aba7492b8169e8c2c', 'request_id': 'req-0f2990cb-1b83-4f37-8947-970dd1d2258f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:05.532141 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b48bb9e33347454aba7492b8169e8c2c', 'request_id': 'req-0f2990cb-1b83-4f37-8947-970dd1d2258f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:05.540153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b48bb9e33347454aba7492b8169e8c2c', 'request_id': 'req-0f2990cb-1b83-4f37-8947-970dd1d2258f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:05.610143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] The token cache is being invalidate because project b48bb9e33347454aba7492b8169e8c2c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:05.610600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:05.611539 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:05.613764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1299/2558] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:05 2022] DELETE /identity/v3/projects/b48bb9e33347454aba7492b8169e8c2c => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:05.618307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.619937 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:05.626686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd046474-6cac-4b87-9831-27fb04874730 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.700002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:INSERT=5,keystone:DELETE=8 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:05.703166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.704027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.704400 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.708671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.708873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f2990cb-1b83-4f37-8947-970dd1d2258f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.709037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.709037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.713558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.714717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.715635 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.717420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] PATH_INFO: `/v3/users/13e5e898b1564339bcf29a687cd3b94e` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.719346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=13e5e898b1564339bcf29a687cd3b94e)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.725383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.729449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1260/2559] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:22:05.734669 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.738819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:05.760115 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c5fe47a-6655-4e38-807f-d5da71af1954 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:05.765838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd878b09-0845-4545-9d0e-550d41dc2a63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:05.766914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878b09-0845-4545-9d0e-550d41dc2a63 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.767241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878b09-0845-4545-9d0e-550d41dc2a63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.767585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd878b09-0845-4545-9d0e-550d41dc2a63 admin admin] PATH_INFO: `/v3/projects/ed80e30d3bc84b3c937f210536ef3fc9/users/7188f112809a46a490a0833e02b1ea0a/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.769862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd878b09-0845-4545-9d0e-550d41dc2a63 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ed80e30d3bc84b3c937f210536ef3fc9, user_id=7188f112809a46a490a0833e02b1ea0a, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:05.773295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd878b09-0845-4545-9d0e-550d41dc2a63 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:05.785753 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1261/2560] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:05 2022] PUT /identity/v3/projects/ed80e30d3bc84b3c937f210536ef3fc9/users/7188f112809a46a490a0833e02b1ea0a/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:05.797394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:05.797738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:05.798141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:05.848589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] MFA Rules not processed for user `7188f112809a46a490a0833e02b1ea0a`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:05.848589 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:05.867208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:05.945449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1262/2561] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:05 2022] POST /identity/v3/auth/tokens => generated 3297 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:05.961294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:05.963069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:05.980529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '13e5e898b1564339bcf29a687cd3b94e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:05.996442 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '13e5e898b1564339bcf29a687cd3b94e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:06.007321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '13e5e898b1564339bcf29a687cd3b94e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:06.008512 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '13e5e898b1564339bcf29a687cd3b94e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:06.052787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e08625a2-c715-4075-8ae8-85be8d5724f8 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:06.057263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:06.058529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:06.058529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:06.058529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:06.072174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:06.076603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:06.088248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1263/2562] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:05 2022] GET /identity/v3/auth/tokens => generated 3297 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:06.101044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '13e5e898b1564339bcf29a687cd3b94e'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:06.115585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1300/2563] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:05 2022] DELETE /identity/v3/users/13e5e898b1564339bcf29a687cd3b94e => generated 0 bytes in 498 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:06.710104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:06.846809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9df0f8-8dc9-4f58-9fa8-3955dcfbdf36 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:06.924870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:06.935695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:06.936258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:06.936738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] PATH_INFO: `/v3/projects/6a2cb9a878454a8e893c072b24e7422c` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:06.940594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] RBAC: Authorizing `identity:delete_project(project_id=6a2cb9a878454a8e893c072b24e7422c)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:06.943261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:06.946602 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:07.128398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6a2cb9a878454a8e893c072b24e7422c', 'request_id': 'req-259e876f-4139-45e7-8546-b208611ae378'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.143488 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6a2cb9a878454a8e893c072b24e7422c', 'request_id': 'req-259e876f-4139-45e7-8546-b208611ae378'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.151404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6a2cb9a878454a8e893c072b24e7422c', 'request_id': 'req-259e876f-4139-45e7-8546-b208611ae378'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.230853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] The token cache is being invalidate because project 6a2cb9a878454a8e893c072b24e7422c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:07.231637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.232639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-259e876f-4139-45e7-8546-b208611ae378 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.234733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.240145 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1264/2564] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:06 2022] DELETE /identity/v3/projects/6a2cb9a878454a8e893c072b24e7422c => generated 0 bytes in 526 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:07.240276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:07.244082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957358-6e42-432f-862d-c7ab0e63e320 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.244382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957358-6e42-432f-862d-c7ab0e63e320 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.244664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df957358-6e42-432f-862d-c7ab0e63e320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.261021 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d53edcb-e565-464c-9d11-e3adaadc9bc0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.268071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-df957358-6e42-432f-862d-c7ab0e63e320 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:07.269427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-df957358-6e42-432f-862d-c7ab0e63e320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:07.334888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.336346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.336633 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.336931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] PATH_INFO: `/v3/users/cecbd75689f548078971c06387321797` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.339073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cecbd75689f548078971c06387321797)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.342251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.368520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1265/2565] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:07.376173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.376493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.376778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.402375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:07.403838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:07.412405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1266/2566] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:07.416429 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.427138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c2fe2-9051-4428-b5a6-9e98a7c7f63e None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.432133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.432913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.433265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.433621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.434468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:07.434843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.442841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.450233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1267/2567] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:22:07.453796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.469878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb8d2b80-4149-4829-86fb-8383010c2d32 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.474894 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.475591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.475876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.476157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.476854 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.479558 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.575937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1268/2568] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:07 2022] POST /identity/v3/projects => generated 369 bytes in 120 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:22:07.577404 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.614663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cecbd75689f548078971c06387321797'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.629683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cecbd75689f548078971c06387321797'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.642749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cecbd75689f548078971c06387321797'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.643629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cecbd75689f548078971c06387321797'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.648543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:07.662914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:07.675392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-801048a8-bd15-4ae3-b765-9148b7592417 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.681036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.681849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.682242 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.682643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.683408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.685578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.739981 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-50992fbe-ee90-4b43-af67-09f545e3e005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cecbd75689f548078971c06387321797'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:07.747932 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1301/2569] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:07 2022] DELETE /identity/v3/users/cecbd75689f548078971c06387321797 => generated 0 bytes in 514 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:07.752353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.752788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.753168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.774911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:07.776395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:07.796951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1269/2570] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:07 2022] POST /identity/v3/users => generated 285 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:22:07.800958 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.803148 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:07.818643 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a373fc5e-40ac-4d49-9164-0a1ea17ada24 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.864997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1302/2571] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:07.876135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.877686 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:07.892858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.899472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.899472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.899472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.899472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.899472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.907483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1270/2572] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:07.911324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.921177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ae6473e-7728-4508-bd23-cf2fea90a9ff admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.925852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.926579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.926850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.927124 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.927867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.929977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.936315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03f448d-ebf1-45d8-b6da-f575e2be424f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.940179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1271/2573] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:22:07.940350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1596f8bb-1b7a-430e-9af2-d89a36d5f611 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.940864 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f8bb-1b7a-430e-9af2-d89a36d5f611 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.941188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f8bb-1b7a-430e-9af2-d89a36d5f611 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.941464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1596f8bb-1b7a-430e-9af2-d89a36d5f611 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.946071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:07.953589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f8bb-1b7a-430e-9af2-d89a36d5f611 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.955135 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1596f8bb-1b7a-430e-9af2-d89a36d5f611 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:07.957023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bbfe64-85a1-44af-bcbe-355ed2fd9ae0 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:07.962823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:07.963827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:07.964186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:07.964579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] PATH_INFO: `/v3/projects/4114d5fbf76541ccaec4835f608a61b5/users/cd2bc7c8747a445da4c3821f00fa6b16/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:07.966659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1303/2574] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:22:07.982209 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4114d5fbf76541ccaec4835f608a61b5, user_id=cd2bc7c8747a445da4c3821f00fa6b16, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:07.984974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:08.077043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1272/2575] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:07 2022] PUT /identity/v3/projects/4114d5fbf76541ccaec4835f608a61b5/users/cd2bc7c8747a445da4c3821f00fa6b16/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:08.089842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:08.090171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:08.090453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:08.118121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] MFA Rules not processed for user `cd2bc7c8747a445da4c3821f00fa6b16`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:08.119337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:08.201728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1304/2576] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:08 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:08.219351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:08.220556 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:08.328931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1325c54-782f-4cf1-b8b2-227818774600 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:08.333396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '62d81f5f899b4113a6a54f0712725656', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:08.334289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:08.334714 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:08.335246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:08.360907 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:08.362717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:08.373780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1273/2577] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:08 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:08.571623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:08.589391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:08.640868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:08.708631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158fb2cf-cd30-4607-ab1c-8aec3d30f288 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:08.713995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:08.715255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:08.715629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:08.716073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] PATH_INFO: `/v3/projects/ee413682d29246ac8cfc20a04f7a22bf` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:08.717606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] RBAC: Authorizing `identity:delete_project(project_id=ee413682d29246ac8cfc20a04f7a22bf)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:08.723006 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:08.863974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ee413682d29246ac8cfc20a04f7a22bf', 'request_id': 'req-f0b41e2b-26e5-4f72-a628-77fd56296cfe'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:08.871342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ee413682d29246ac8cfc20a04f7a22bf', 'request_id': 'req-f0b41e2b-26e5-4f72-a628-77fd56296cfe'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:08.877815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ee413682d29246ac8cfc20a04f7a22bf', 'request_id': 'req-f0b41e2b-26e5-4f72-a628-77fd56296cfe'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:08.950994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] The token cache is being invalidate because project ee413682d29246ac8cfc20a04f7a22bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:08.950994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:08.950994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:08.950994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1305/2578] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:08 2022] DELETE /identity/v3/projects/ee413682d29246ac8cfc20a04f7a22bf => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:08.952505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:08.963724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7aba628-3a6b-4854-8501-df4e6bab3ed5 service glance] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:09.022423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:09.041934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:09.043540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:09.044089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:09.044248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] PATH_INFO: `/v3/users/7188f112809a46a490a0833e02b1ea0a` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:09.045630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7188f112809a46a490a0833e02b1ea0a)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:09.047777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:09.243353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7188f112809a46a490a0833e02b1ea0a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:09.251355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7188f112809a46a490a0833e02b1ea0a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:09.264066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7188f112809a46a490a0833e02b1ea0a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:09.265108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7188f112809a46a490a0833e02b1ea0a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:09.331738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7188f112809a46a490a0833e02b1ea0a'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:09.352315 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1274/2579] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:08 2022] DELETE /identity/v3/users/7188f112809a46a490a0833e02b1ea0a => generated 0 bytes in 400 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:09.677774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:09.680447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:09.693296 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0b41e2b-26e5-4f72-a628-77fd56296cfe admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:09.797247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:09.798264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:09.798615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:09.798960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] PATH_INFO: `/v3/users/cdc9e76e076f42ac847ada1a823d807d` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:09.801216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cdc9e76e076f42ac847ada1a823d807d)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:09.804735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:09.925900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:09.927933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:09.950547 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de7b53fa-37a4-4dfd-a277-a58842c7b9a8 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:09.997721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.001995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.003314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.003821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] PATH_INFO: `/v3/projects/ed80e30d3bc84b3c937f210536ef3fc9` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.005427 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ed80e30d3bc84b3c937f210536ef3fc9)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.007575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.017446 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cdc9e76e076f42ac847ada1a823d807d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.036299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:10.047323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cdc9e76e076f42ac847ada1a823d807d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.056206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cdc9e76e076f42ac847ada1a823d807d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.057082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cdc9e76e076f42ac847ada1a823d807d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.135503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ed80e30d3bc84b3c937f210536ef3fc9', 'request_id': 'req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.137984 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b569a425-3b73-4920-8adf-ac21923f66a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cdc9e76e076f42ac847ada1a823d807d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.145182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ed80e30d3bc84b3c937f210536ef3fc9', 'request_id': 'req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.154099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1306/2580] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:09 2022] DELETE /identity/v3/users/cdc9e76e076f42ac847ada1a823d807d => generated 0 bytes in 476 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:10.157699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.157996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.158316 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.162008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ed80e30d3bc84b3c937f210536ef3fc9', 'request_id': 'req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.179424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:10.180916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:10.262068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1307/2581] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:10.269430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.269665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] The token cache is being invalidate because project ed80e30d3bc84b3c937f210536ef3fc9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:10.269901 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.270686 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-efc11d64-ea5a-4047-b982-8d82a2e6eaf2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:10.271393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:10.273999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1275/2582] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:09 2022] DELETE /identity/v3/projects/ed80e30d3bc84b3c937f210536ef3fc9 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:10.282877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ec96b-1200-4baf-8ecf-646887246c7a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.283162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ec96b-1200-4baf-8ecf-646887246c7a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.283441 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704ec96b-1200-4baf-8ecf-646887246c7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.308348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-704ec96b-1200-4baf-8ecf-646887246c7a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:10.309667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-704ec96b-1200-4baf-8ecf-646887246c7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:10.328202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1276/2583] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:10.329797 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.330236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.330579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.342943 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbdca3eb-de96-48fe-b4d1-866544fb1f9c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.350198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:10.352228 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:10.355428 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.356113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.356401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.356698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.358733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:10.362399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1277/2584] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:10.367492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.378628 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215a75b4-37bf-4032-8139-63ffdefc1a79 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.384302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.385152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.385533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.385954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.386905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:10.387318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.388931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.390169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.390417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.403526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1308/2585] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:22:10.408235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1278/2586] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:22:10.412731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.425564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d94250-ddf0-44ae-8c83-463f25943ec5 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.437181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.437865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.440083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.440376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.441413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.443605 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.576294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1309/2587] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:10 2022] POST /identity/v3/projects => generated 375 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:22:10.581410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.594512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ae26c4f-e378-4a5b-b933-cebeaccb7938 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.621639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:10.696852 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.698433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.698943 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.699477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.700763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.703578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.823898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1279/2588] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:10 2022] POST /identity/v3/users => generated 288 bytes in 244 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:10.832339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.848180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9359a5-7b69-4efa-8bba-48f48c23f233 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.853931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.854680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.854964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.855301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.856188 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.857935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.876449 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1310/2589] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:10.880533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.899528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.899528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:10.905611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c68ee733-6877-4323-aa5e-ad321cc0aa53 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.915390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.916543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.921800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.921800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.921800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.921800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.922338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8749eff-2e30-49fe-ac28-9cb482f74e47 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.927732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.930293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.930651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.931121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] PATH_INFO: `/v3/projects/5915d4ce62e946e59053027d6ebc8026` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.937875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1280/2590] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:10 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:10.942083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] RBAC: Authorizing `identity:delete_project(project_id=5915d4ce62e946e59053027d6ebc8026)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.942083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:10.944764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:10.953464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b83e3fa6-5809-4a9a-ae76-4388dac1a0ba admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:10.958292 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca8e8058-1f0d-4aa3-b438-e58e86327745 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:10.959233 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8058-1f0d-4aa3-b438-e58e86327745 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:10.959460 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8058-1f0d-4aa3-b438-e58e86327745 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:10.960447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca8e8058-1f0d-4aa3-b438-e58e86327745 admin admin] PATH_INFO: `/v3/projects/decb12852e7d415d8a89ce33b1b9d335/users/01b706674a8d410bb9e10465eb34c666/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:10.981477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8058-1f0d-4aa3-b438-e58e86327745 admin admin] RBAC: Authorizing `identity:create_grant(project_id=decb12852e7d415d8a89ce33b1b9d335, user_id=01b706674a8d410bb9e10465eb34c666, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:10.984523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca8e8058-1f0d-4aa3-b438-e58e86327745 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:11.062320 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1281/2591] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:10 2022] PUT /identity/v3/projects/decb12852e7d415d8a89ce33b1b9d335/users/01b706674a8d410bb9e10465eb34c666/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:11.077510 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:11.077814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:11.078166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:11.114593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] MFA Rules not processed for user `01b706674a8d410bb9e10465eb34c666`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:11.116078 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:11.119220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:11.120889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5915d4ce62e946e59053027d6ebc8026', 'request_id': 'req-b8421508-5b3f-48cb-ac1f-717231259b29'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:11.126651 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5915d4ce62e946e59053027d6ebc8026', 'request_id': 'req-b8421508-5b3f-48cb-ac1f-717231259b29'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:11.135707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5915d4ce62e946e59053027d6ebc8026', 'request_id': 'req-b8421508-5b3f-48cb-ac1f-717231259b29'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:11.211813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] The token cache is being invalidate because project 5915d4ce62e946e59053027d6ebc8026 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:11.212211 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:11.216612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:11.233350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1311/2592] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:10 2022] DELETE /identity/v3/projects/5915d4ce62e946e59053027d6ebc8026 => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:11.238963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1282/2593] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:11 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:11.247127 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:11.252176 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:11.427863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8421508-5b3f-48cb-ac1f-717231259b29 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:11.442168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:11.445664 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:11.446154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:11.449126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:11.449126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:11.449401 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:11.546746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1312/2594] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:11 2022] POST /identity/v3/projects => generated 377 bytes in 297 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:11.548207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:11.562648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955741bc-a34a-4989-b4ef-77a1fb129b27 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:11.648019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:11.648982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:11.649314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:11.649727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:11.650755 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:11.653061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:11.664420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:12.040538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1283/2595] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:11 2022] POST /identity/v3/users => generated 289 bytes in 493 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:22:12.041637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.052650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6a61f9-bf1a-459e-a96a-12f24db1a768 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.060205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.060982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.061337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.061707 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.062561 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.064246 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.076239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1313/2596] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:22:12.080251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.092430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a1a3841-dd78-4b8c-ade8-68515b18d223 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.099279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e42700b-eadc-48fe-bfd0-82d7656ba835 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.100293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42700b-eadc-48fe-bfd0-82d7656ba835 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.101356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42700b-eadc-48fe-bfd0-82d7656ba835 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.101727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e42700b-eadc-48fe-bfd0-82d7656ba835 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.102581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42700b-eadc-48fe-bfd0-82d7656ba835 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.104338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e42700b-eadc-48fe-bfd0-82d7656ba835 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.120312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1284/2597] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:22:12.121842 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.132308 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a318948-dd5a-4fee-883e-473f2211d2f1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.137074 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.137950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.138732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.145588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] PATH_INFO: `/v3/projects/f1efdc119e1c4f16bd1dd8b61275b9ae/users/a1e2aca75708477595ad8fd5c8176b5e/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.156138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] RBAC: Authorizing `identity:create_grant(project_id=f1efdc119e1c4f16bd1dd8b61275b9ae, user_id=a1e2aca75708477595ad8fd5c8176b5e, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.158849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.215358 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1314/2598] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:12 2022] PUT /identity/v3/projects/f1efdc119e1c4f16bd1dd8b61275b9ae/users/a1e2aca75708477595ad8fd5c8176b5e/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:12.229984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.230325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.230599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.260143 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] MFA Rules not processed for user `a1e2aca75708477595ad8fd5c8176b5e`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:12.261448 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:12.331160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1285/2599] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:12 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:12.336398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.407351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-473a0f1c-9037-4eb8-a1b6-6fe254c15a8e admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.413054 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.414567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.415115 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.415618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.416556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.418739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.515072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1315/2600] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:12 2022] POST /identity/v3/projects => generated 377 bytes in 180 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:12.518992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.543483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e098acb5-7914-45fa-a047-18d5bb66fbaf None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.647692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.648397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.648749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.649131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.650132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.652291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.732985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1286/2601] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:12 2022] POST /identity/v3/users => generated 295 bytes in 214 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:12.737389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.749298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e3b63c8-2133-49bc-867e-1f448e84bd67 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.755420 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.756199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.756593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.756936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.757819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.759520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.761169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:12.771370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1316/2602] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:12.775916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.786452 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3d55257-9f63-4c39-ada4-89fcb4bb04ba admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.792476 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.793391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.793675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.793955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] PATH_INFO: `/v3/projects/bb388a70f8204bdf9ea3a3593cf053cb/users/c6181137a91c49aa94df36437cd25010/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.809979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb388a70f8204bdf9ea3a3593cf053cb, user_id=c6181137a91c49aa94df36437cd25010, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.812784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:12.905183 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1287/2603] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:12 2022] PUT /identity/v3/projects/bb388a70f8204bdf9ea3a3593cf053cb/users/c6181137a91c49aa94df36437cd25010/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 130 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:12.909142 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:12.920221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f578fef-5277-4104-9a8b-5b7d911d76c7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:12.981614 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def4faa4-d9e0-4307-a63d-1a9595e466a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:12.982339 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4faa4-d9e0-4307-a63d-1a9595e466a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:12.982627 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4faa4-d9e0-4307-a63d-1a9595e466a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:12.982901 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def4faa4-d9e0-4307-a63d-1a9595e466a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:12.983638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4faa4-d9e0-4307-a63d-1a9595e466a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:12.985271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-def4faa4-d9e0-4307-a63d-1a9595e466a6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:13.000549 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1317/2604] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:12 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:13.005497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:13.012857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea568f7-9281-4663-a5a1-51aef04391a6 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:13.021545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:13.023121 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:13.023407 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:13.023690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] PATH_INFO: `/v3/projects/bb388a70f8204bdf9ea3a3593cf053cb/users/c6181137a91c49aa94df36437cd25010/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:13.025820 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bb388a70f8204bdf9ea3a3593cf053cb, user_id=c6181137a91c49aa94df36437cd25010, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:13.028616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:13.047949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1288/2605] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:13 2022] PUT /identity/v3/projects/bb388a70f8204bdf9ea3a3593cf053cb/users/c6181137a91c49aa94df36437cd25010/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 40 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:13.058059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:13.058059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:13.058059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:13.084297 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] MFA Rules not processed for user `c6181137a91c49aa94df36437cd25010`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:13.094594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:13.165609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1318/2606] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:13 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:13.178684 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:13.184011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:13.216302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:INSERT=6,keystone:SELECT=94 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:13.247659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753e1810-a7fe-42c4-ad5d-7d11a26b8ae5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:13.255662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:13.257072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:13.257425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:13.257739 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:13.269413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:13.270949 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:13.284727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1289/2607] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:13 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:14.187238 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:14.188828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:14.201337 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6828749b-07cb-48de-8b6e-57abfc5ac0eb None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:14.204915 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6c9e131-1724-40c0-a332-d0ef0f4b5201 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:14.205553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e131-1724-40c0-a332-d0ef0f4b5201 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:14.205832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e131-1724-40c0-a332-d0ef0f4b5201 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:14.206154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6c9e131-1724-40c0-a332-d0ef0f4b5201 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:14.263431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9e131-1724-40c0-a332-d0ef0f4b5201 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:14.264827 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6c9e131-1724-40c0-a332-d0ef0f4b5201 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:14.275182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1319/2608] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:14 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:18.266817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:18.337471 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52372916-7623-47a5-90d0-29e47c1f9685 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:18.342618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:18.343487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:18.343766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:18.344036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] PATH_INFO: `/v3/users/01b706674a8d410bb9e10465eb34c666` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:18.345224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=01b706674a8d410bb9e10465eb34c666)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:18.347156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:18.511815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01b706674a8d410bb9e10465eb34c666'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:18.518862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01b706674a8d410bb9e10465eb34c666'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:18.535168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01b706674a8d410bb9e10465eb34c666'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:18.535908 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01b706674a8d410bb9e10465eb34c666'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:18.611553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01b706674a8d410bb9e10465eb34c666'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:18.618445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1290/2609] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:18 2022] DELETE /identity/v3/users/01b706674a8d410bb9e10465eb34c666 => generated 0 bytes in 352 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:18.623415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:18.628591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:18.628591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:18.642588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:18.643839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:18.653998 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:18.704028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1320/2610] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:18.714680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:18.716127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:18.770018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:18.775652 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f1508c2-3cf5-437e-aa35-962c10c7e6d4 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:18.783147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:18.783147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:18.783147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:18.783147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:18.789750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:18.791243 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:18.801374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1291/2611] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:19.201302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:19.202868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:19.215778 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a586800-83ee-4d27-9502-8739a7f7cb83 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:19.220385 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:19.221302 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:19.221529 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:19.221830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] PATH_INFO: `/v3/projects/decb12852e7d415d8a89ce33b1b9d335` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:19.223070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] RBAC: Authorizing `identity:delete_project(project_id=decb12852e7d415d8a89ce33b1b9d335)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:19.225034 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:19.330065 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'decb12852e7d415d8a89ce33b1b9d335', 'request_id': 'req-5f9f9edb-f080-4971-a14b-94aafc9f52e8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.336098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'decb12852e7d415d8a89ce33b1b9d335', 'request_id': 'req-5f9f9edb-f080-4971-a14b-94aafc9f52e8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.342368 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'decb12852e7d415d8a89ce33b1b9d335', 'request_id': 'req-5f9f9edb-f080-4971-a14b-94aafc9f52e8'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.411236 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] The token cache is being invalidate because project decb12852e7d415d8a89ce33b1b9d335 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:19.411531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.412156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5f9f9edb-f080-4971-a14b-94aafc9f52e8 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.413863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1321/2612] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:19 2022] DELETE /identity/v3/projects/decb12852e7d415d8a89ce33b1b9d335 => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:19.417946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:19.427588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c859626a-c72b-4c0c-8771-60a79fc1eb3b service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:19.444638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:19.444927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:19.445205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:19.463345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:19.465122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:19.491963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:19.492870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:19.493158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:19.493440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] PATH_INFO: `/v3/users/a1e2aca75708477595ad8fd5c8176b5e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:19.494678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1e2aca75708477595ad8fd5c8176b5e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:19.497158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:19.538565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1322/2613] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 6 17:22:19 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:22:19.555959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:19.557997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:19.605809 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:19.629970 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-deabc0dc-0085-4311-8e30-db6b092dc7ae None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:19.635226 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:19.636437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:19.636721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:19.637000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:19.645310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:19.646914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:19.654960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1323/2614] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:22:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Jul 06 17:22:19.672546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1e2aca75708477595ad8fd5c8176b5e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.679878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1e2aca75708477595ad8fd5c8176b5e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.692773 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1e2aca75708477595ad8fd5c8176b5e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.693504 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1e2aca75708477595ad8fd5c8176b5e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.796604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1e2aca75708477595ad8fd5c8176b5e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:19.803049 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1292/2615] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:19 2022] DELETE /identity/v3/users/a1e2aca75708477595ad8fd5c8176b5e => generated 0 bytes in 386 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:20.267002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:20.268079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:20.283613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9541d36-ef11-4f73-8027-e4efb2aed734 service swift] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:20.343568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:20.344421 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:20.344705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:20.344979 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] PATH_INFO: `/v3/projects/f1efdc119e1c4f16bd1dd8b61275b9ae` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:20.346184 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f1efdc119e1c4f16bd1dd8b61275b9ae)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:20.348169 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:20.462580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f1efdc119e1c4f16bd1dd8b61275b9ae', 'request_id': 'req-041a8845-effd-47e3-bd43-683440ced011'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.468528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f1efdc119e1c4f16bd1dd8b61275b9ae', 'request_id': 'req-041a8845-effd-47e3-bd43-683440ced011'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.474733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f1efdc119e1c4f16bd1dd8b61275b9ae', 'request_id': 'req-041a8845-effd-47e3-bd43-683440ced011'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.561954 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] The token cache is being invalidate because project f1efdc119e1c4f16bd1dd8b61275b9ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:20.562275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.564918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.564918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1324/2616] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:20 2022] DELETE /identity/v3/projects/f1efdc119e1c4f16bd1dd8b61275b9ae => generated 0 bytes in 299 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:20.568487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:20.569909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:20.583253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cba1da5d-aaae-423d-a5af-26d5bd2e4005 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:20.646537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:20.647425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:20.647713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:20.647996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] PATH_INFO: `/v3/users/c6181137a91c49aa94df36437cd25010` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:20.650634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] RBAC: Authorizing `identity:delete_user(user_id=c6181137a91c49aa94df36437cd25010)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:20.653362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:20.664231 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:20.865612 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c6181137a91c49aa94df36437cd25010'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.873804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c6181137a91c49aa94df36437cd25010'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.886016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c6181137a91c49aa94df36437cd25010'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:20.898184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c6181137a91c49aa94df36437cd25010'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.034649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-9e5bb56c-c58e-4210-b3c1-aedb76e9ea1d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c6181137a91c49aa94df36437cd25010'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.041058 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1293/2617] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:20 2022] DELETE /identity/v3/users/c6181137a91c49aa94df36437cd25010 => generated 0 bytes in 473 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:21.432066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:21.433565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:21.447733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-041a8845-effd-47e3-bd43-683440ced011 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:21.504235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:21.505089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:21.505374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:21.505653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] PATH_INFO: `/v3/projects/bb388a70f8204bdf9ea3a3593cf053cb` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:21.506867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bb388a70f8204bdf9ea3a3593cf053cb)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:21.508767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:21.515307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:21.650301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bb388a70f8204bdf9ea3a3593cf053cb', 'request_id': 'req-00852fa0-7ed1-4870-b920-f240ed66f161'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.656026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bb388a70f8204bdf9ea3a3593cf053cb', 'request_id': 'req-00852fa0-7ed1-4870-b920-f240ed66f161'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.662167 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bb388a70f8204bdf9ea3a3593cf053cb', 'request_id': 'req-00852fa0-7ed1-4870-b920-f240ed66f161'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.730636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] The token cache is being invalidate because project bb388a70f8204bdf9ea3a3593cf053cb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:21.730923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.731548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-00852fa0-7ed1-4870-b920-f240ed66f161 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:21.733099 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1325/2618] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:21 2022] DELETE /identity/v3/projects/bb388a70f8204bdf9ea3a3593cf053cb => generated 0 bytes in 302 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:21.739271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:21.739770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:21.739879 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:21.757934 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:21.759160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:21.816870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1294/2619] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:21.825669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:21.825994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:21.826306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:21.845485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:21.846732 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:21.855033 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1326/2620] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:21.859276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:21.869182 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-872a2861-631a-4d37-a8ce-19000b43a7b9 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:21.874425 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:21.875087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:21.875376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:21.875659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:21.876394 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:21.876705 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:21.878324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:21.891080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1295/2621] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:22:21.895624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:21.905057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323e119a-9a56-44ff-b3d4-092633b7f3ec None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:21.909678 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:21.910367 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:21.910652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:21.910931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:21.911643 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:21.913553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:22.038319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1327/2622] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:21 2022] POST /identity/v3/projects => generated 373 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:22.042624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:22.052890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2834c6-2cc0-4073-9103-f0897c91206c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:22.111062 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:22.111981 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:22.112272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:22.112582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:22.113269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:22.115230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:22.213856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1296/2623] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:22 2022] POST /identity/v3/users => generated 287 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:22.218083 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:22.228303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d62769b9-4319-4596-9efd-83e659d06626 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:22.233464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:22.235502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:22.235502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:22.235502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:22.235502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:22.237265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:22.249404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1328/2624] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:22.253279 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:22.259660 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:DELETE=10,keystone:SELECT=86,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:22.263777 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-343c7fc6-6763-4d9e-a1e8-f2bfaf972468 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:22.268405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a404b9f1-9771-41a4-a043-596c27e286a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:22.269063 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b9f1-9771-41a4-a043-596c27e286a8 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:22.269349 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b9f1-9771-41a4-a043-596c27e286a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:22.269673 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a404b9f1-9771-41a4-a043-596c27e286a8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:22.270444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404b9f1-9771-41a4-a043-596c27e286a8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:22.272031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a404b9f1-9771-41a4-a043-596c27e286a8 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:22.282882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1297/2625] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:22.287040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:22.297591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebc1b5d9-1e4f-4b19-befc-e7fb657149ce admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:22.302292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:22.305239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:22.305239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:22.305239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] PATH_INFO: `/v3/projects/d35dc97ba8d8474c89fcfc3e86bb0fae/users/95d0a4c494e149629ab3cc4031f08bdd/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:22.318576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d35dc97ba8d8474c89fcfc3e86bb0fae, user_id=95d0a4c494e149629ab3cc4031f08bdd, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:22.321232 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:22.385084 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1329/2626] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:22 2022] PUT /identity/v3/projects/d35dc97ba8d8474c89fcfc3e86bb0fae/users/95d0a4c494e149629ab3cc4031f08bdd/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 98 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:22:22.390378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207585-90ef-41e6-b45f-f85e4cf2c910 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:22.390634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207585-90ef-41e6-b45f-f85e4cf2c910 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:22.390917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37207585-90ef-41e6-b45f-f85e4cf2c910 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:22.408071 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-37207585-90ef-41e6-b45f-f85e4cf2c910 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:22.409272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-37207585-90ef-41e6-b45f-f85e4cf2c910 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:22.467307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1298/2627] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:22.476653 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:22.478414 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:22.534574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9802ba7-08d3-42b2-adf8-238ea71a5be3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:22.538185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:22.538819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:22.539100 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:22.539380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:22.549220 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:22.550685 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:22.560739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1330/2628] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:23.793104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:23.797734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:23.797734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:23.821935 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] MFA Rules not processed for user `95d0a4c494e149629ab3cc4031f08bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:23.823203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:23.889509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1299/2629] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:23 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:23.894130 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:23.903816 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddc31681-bec1-474a-80f0-263a4b9b750a service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:23.908280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:23.908918 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:23.909197 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:23.909471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:23.910200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:23.912082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:24.020680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1331/2630] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:23 2022] POST /identity/v3/projects => generated 373 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:24.024838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:24.035953 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70a2a9e4-f2cc-45ad-86af-4dab2d907c98 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:24.091026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:24.091683 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:24.091964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:24.092260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:24.092937 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:24.094886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:24.208072 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1300/2631] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:24 2022] POST /identity/v3/users => generated 293 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:24.211991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:24.223497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-091d7ea0-6187-49e2-8827-94162101cc1c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:24.228179 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:24.228834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:24.229113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:24.230057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:24.230806 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:24.232396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:24.237948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:24.243404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1332/2632] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:24.247489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:24.257433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abb562f6-5363-42cd-a799-62625556a8aa admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:24.261968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:24.262872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:24.263158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:24.263442 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] PATH_INFO: `/v3/projects/d14191b4a27049a0a88fbbd6b4ea7f46/users/5b7c0918a34e480eac23a929032631d3/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:24.274630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:24.279131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14191b4a27049a0a88fbbd6b4ea7f46, user_id=5b7c0918a34e480eac23a929032631d3, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:24.281794 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:24.348001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1301/2633] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:24 2022] PUT /identity/v3/projects/d14191b4a27049a0a88fbbd6b4ea7f46/users/5b7c0918a34e480eac23a929032631d3/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:24.351936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:24.362146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0fae21-77de-4f0e-aa36-77e615de1aef admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:24.418456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5958241-e823-4efc-a87f-dbc38420b477 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:24.419126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958241-e823-4efc-a87f-dbc38420b477 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:24.419407 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958241-e823-4efc-a87f-dbc38420b477 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:24.419680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5958241-e823-4efc-a87f-dbc38420b477 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:24.420410 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5958241-e823-4efc-a87f-dbc38420b477 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:24.421997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5958241-e823-4efc-a87f-dbc38420b477 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:24.439121 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1333/2634] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:24 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:24.442967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:24.454022 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f393a2e1-e8a7-4b2b-b743-3dbdb70d4897 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:24.458825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6be22235-a4b1-4ca8-a593-41a231b5c950 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:24.459641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be22235-a4b1-4ca8-a593-41a231b5c950 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:24.459922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be22235-a4b1-4ca8-a593-41a231b5c950 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:24.460224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6be22235-a4b1-4ca8-a593-41a231b5c950 admin admin] PATH_INFO: `/v3/projects/d14191b4a27049a0a88fbbd6b4ea7f46/users/5b7c0918a34e480eac23a929032631d3/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:24.462229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be22235-a4b1-4ca8-a593-41a231b5c950 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d14191b4a27049a0a88fbbd6b4ea7f46, user_id=5b7c0918a34e480eac23a929032631d3, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:24.465483 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6be22235-a4b1-4ca8-a593-41a231b5c950 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:24.475562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1302/2635] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:24 2022] PUT /identity/v3/projects/d14191b4a27049a0a88fbbd6b4ea7f46/users/5b7c0918a34e480eac23a929032631d3/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:25.727224 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:25.729480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:25.729480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:25.755897 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] MFA Rules not processed for user `5b7c0918a34e480eac23a929032631d3`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:25.757123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:25.827240 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1334/2636] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:25 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:25.837992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:25.838480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:25.838591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:25.857665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] MFA Rules not processed for user `95d0a4c494e149629ab3cc4031f08bdd`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:25.858936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:25.913715 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1303/2637] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:25 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:25.924898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:25.926323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:25.998750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52ab8696-c6f4-42f9-b04c-d0ed61ab14c5 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:26.004192 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '45e533c543494ad2a9a294458fa79d14', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['ResellerAdmin', 'reader', 'member', 'service', 'admin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:26.004833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:26.005110 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:26.005394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:26.013763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:26.015374 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:26.024270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1335/2638] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:25 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:26.250573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:26.251886 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:26.309208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b7c9ab-a4ae-4b79-bedc-3b554ec85c62 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:26.312805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:26.313464 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:26.313744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:26.314017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:26.315931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:26.326232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:26.327666 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc6aee6-b2b6-4ea2-b701-66e14d732528 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:26.335534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1304/2639] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:26 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:32.499487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:32.500939 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:32.510927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:32.566705 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f00af5d-ef58-43e1-926c-5dee5d105df8 service nova] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:32.571182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:32.572044 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:32.572330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:32.572608 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] PATH_INFO: `/v3/users/cd2bc7c8747a445da4c3821f00fa6b16` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:32.574353 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2bc7c8747a445da4c3821f00fa6b16)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:32.576266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:32.755607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2bc7c8747a445da4c3821f00fa6b16'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:32.768031 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2bc7c8747a445da4c3821f00fa6b16'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:32.774916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2bc7c8747a445da4c3821f00fa6b16'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:32.775600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2bc7c8747a445da4c3821f00fa6b16'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:32.840222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2bc7c8747a445da4c3821f00fa6b16'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:32.846460 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1336/2640] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:32 2022] DELETE /identity/v3/users/cd2bc7c8747a445da4c3821f00fa6b16 => generated 0 bytes in 347 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:32.857861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:32.857861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:32.857861 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:32.869591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:32.870812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:32.929557 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1305/2641] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:32.939818 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:32.941239 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:32.997058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9029d73a-0fd1-4aef-9098-be7fcc4ebc35 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:33.000690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d8f4924-957e-47e7-b0bf-9634bdedad49 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:33.001325 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f4924-957e-47e7-b0bf-9634bdedad49 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:33.001606 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f4924-957e-47e7-b0bf-9634bdedad49 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:33.001882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d8f4924-957e-47e7-b0bf-9634bdedad49 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:33.010836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f4924-957e-47e7-b0bf-9634bdedad49 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:33.012728 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d8f4924-957e-47e7-b0bf-9634bdedad49 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:33.022039 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1337/2642] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:32 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:33.412664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:33.414227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:33.427857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0dd13-3770-4e52-b673-b44fccc8657f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:33.432494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:33.434056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:33.434337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:33.434615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] PATH_INFO: `/v3/projects/4114d5fbf76541ccaec4835f608a61b5` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:33.435836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] RBAC: Authorizing `identity:delete_project(project_id=4114d5fbf76541ccaec4835f608a61b5)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:33.437749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:33.459770 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:33.581200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4114d5fbf76541ccaec4835f608a61b5', 'request_id': 'req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:33.587671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4114d5fbf76541ccaec4835f608a61b5', 'request_id': 'req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:33.595772 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4114d5fbf76541ccaec4835f608a61b5', 'request_id': 'req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:33.677665 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] The token cache is being invalidate because project 4114d5fbf76541ccaec4835f608a61b5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:33.677959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:33.678633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-a8f37a1c-c417-4ce4-a25c-f18fec4a213f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:33.684046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1306/2643] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:33 2022] DELETE /identity/v3/projects/4114d5fbf76541ccaec4835f608a61b5 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:33.685768 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:33.686260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:33.686356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:33.704507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:33.705741 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:33.731899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:33.767057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1338/2644] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:33.774913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:33.775205 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:33.775490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:33.796105 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:33.797245 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:33.805398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1307/2645] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:33.810381 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:33.820839 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1faa812-5ba5-4ec6-a932-dcecc57315b6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:33.825591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:33.826272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:33.826562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:33.826834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:33.827562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:33.827863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:33.830241 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:33.842788 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1339/2646] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:22:33.847952 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:33.857033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c912225c-320d-49f5-bb8c-f56cbd995469 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:33.862019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:33.862702 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:33.862985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:33.863268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:33.863994 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:33.865893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:33.952880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1308/2647] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:33 2022] POST /identity/v3/projects => generated 373 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:33.957173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:33.967695 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65e5e281-573e-40d8-8f72-43e85f488605 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:34.023620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:34.024301 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.024588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.024865 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.025599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:34.028080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:34.123253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1340/2648] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:33 2022] POST /identity/v3/users => generated 287 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:34.127620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:34.138249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f08879-5d25-4b9f-b088-85191514c8aa admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:34.142774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:34.143720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.144001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.144272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.145025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:34.147135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:34.157812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1309/2649] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:34.161833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:34.172704 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b704e407-1385-433a-9046-a93d4f85c046 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:34.177328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d045b673-a4d5-48b9-87bc-f46a879763a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:34.177962 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045b673-a4d5-48b9-87bc-f46a879763a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.178278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045b673-a4d5-48b9-87bc-f46a879763a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.178583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d045b673-a4d5-48b9-87bc-f46a879763a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.179336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045b673-a4d5-48b9-87bc-f46a879763a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:34.181070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d045b673-a4d5-48b9-87bc-f46a879763a6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:34.191567 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1341/2650] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:34.195229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:34.205207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-876dc1f9-ae4c-41bc-946d-699b2abcc938 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:34.209849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:34.210754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.211044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.211327 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] PATH_INFO: `/v3/projects/91de41075ba442c5af3f776a14c31bbc/users/c93050b30c9e47a3a2d6af73be937a6d/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.225482 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] RBAC: Authorizing `identity:create_grant(project_id=91de41075ba442c5af3f776a14c31bbc, user_id=c93050b30c9e47a3a2d6af73be937a6d, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:34.228186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:34.328160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1310/2651] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:34 2022] PUT /identity/v3/projects/91de41075ba442c5af3f776a14c31bbc/users/c93050b30c9e47a3a2d6af73be937a6d/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:34.338598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.338890 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.339279 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.365982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] MFA Rules not processed for user `c93050b30c9e47a3a2d6af73be937a6d`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:34.367231 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:34.428935 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1342/2652] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:34 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:34.440496 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:34.442222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:34.498048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b755173-6d18-4f1b-a3bb-d229ec26d804 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:34.501604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79ff76e-888f-4d43-86e1-bef052dd4954 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:34.502277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff76e-888f-4d43-86e1-bef052dd4954 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.502562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff76e-888f-4d43-86e1-bef052dd4954 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.502841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79ff76e-888f-4d43-86e1-bef052dd4954 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.510979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ff76e-888f-4d43-86e1-bef052dd4954 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:34.512940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79ff76e-888f-4d43-86e1-bef052dd4954 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:34.521663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1311/2653] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:34 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:34.544823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:34.571871 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:34.606620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-381be86b-94a5-4073-b79d-cdac947349a6 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:34.611248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:34.612394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.612674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.612950 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] PATH_INFO: `/v3/users/c93050b30c9e47a3a2d6af73be937a6d` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.614181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93050b30c9e47a3a2d6af73be937a6d)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:34.616093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:34.821319 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93050b30c9e47a3a2d6af73be937a6d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:34.833534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93050b30c9e47a3a2d6af73be937a6d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:34.840568 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93050b30c9e47a3a2d6af73be937a6d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:34.841362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93050b30c9e47a3a2d6af73be937a6d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:34.910278 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93050b30c9e47a3a2d6af73be937a6d'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:34.916578 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1343/2654] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:34 2022] DELETE /identity/v3/users/c93050b30c9e47a3a2d6af73be937a6d => generated 0 bytes in 372 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:34.921636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:34.922132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:34.922264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:34.940413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:34.941587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:34.982503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:34.999523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1312/2655] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:35.009144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:35.010573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:35.065952 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9f726e5-53e0-432c-bf0d-8b270b916b5a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:35.069588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ba62a97-d045-4a96-b63b-415c443e8bf2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:35.070259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba62a97-d045-4a96-b63b-415c443e8bf2 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:35.070545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba62a97-d045-4a96-b63b-415c443e8bf2 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:35.070820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ba62a97-d045-4a96-b63b-415c443e8bf2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:35.079885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba62a97-d045-4a96-b63b-415c443e8bf2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:35.081314 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ba62a97-d045-4a96-b63b-415c443e8bf2 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:35.090711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1344/2656] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:35.521329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:35.526447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:35.544575 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f110d7c6-6abb-4aa9-82c3-434a9177ad9a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:35.556108 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:35.556656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:35.556656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:35.557044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] PATH_INFO: `/v3/projects/91de41075ba442c5af3f776a14c31bbc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:35.557970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] RBAC: Authorizing `identity:delete_project(project_id=91de41075ba442c5af3f776a14c31bbc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:35.559968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:35.672075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '91de41075ba442c5af3f776a14c31bbc', 'request_id': 'req-78deae9f-706f-4406-8ec5-cc84e05aa114'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:35.677515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '91de41075ba442c5af3f776a14c31bbc', 'request_id': 'req-78deae9f-706f-4406-8ec5-cc84e05aa114'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:35.683688 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '91de41075ba442c5af3f776a14c31bbc', 'request_id': 'req-78deae9f-706f-4406-8ec5-cc84e05aa114'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:35.755719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] The token cache is being invalidate because project 91de41075ba442c5af3f776a14c31bbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:35.756015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:35.756635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-78deae9f-706f-4406-8ec5-cc84e05aa114 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:35.767413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1313/2657] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:35 2022] DELETE /identity/v3/projects/91de41075ba442c5af3f776a14c31bbc => generated 0 bytes in 237 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:35.767509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:35.767509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:35.767509 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:35.784097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:35.785673 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:35.831117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:35.848862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1345/2658] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:35.914972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:35.915251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:35.915533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:35.934561 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:35.935782 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:35.944021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1314/2659] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:35.948338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:35.959145 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a5d3eb-cf86-4be1-9179-1844ef4cc29b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:35.963798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:35.964482 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:35.964767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:35.965045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:35.965804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:22:35.966148 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:35.967747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:35.980146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1346/2660] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:22:35.985101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:35.998933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cff767-2031-4173-b0bb-778e908fb59d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:36.004050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:36.004713 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.005001 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.005286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.005985 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:36.008354 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:36.124774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1315/2661] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:22:35 2022] POST /identity/v3/projects => generated 375 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:36.129005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:36.141244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03f4dfde-c287-47a8-883d-138ce3cd3108 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:36.200854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:36.201534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.201814 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.202125 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.202831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:36.204762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:36.331921 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1347/2662] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:22:36 2022] POST /identity/v3/users => generated 288 bytes in 200 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:22:36.333181 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:36.344011 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4870e084-1212-470c-ac38-f7623100c6da admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:36.348656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:36.349333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.349622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.349904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.350880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:36.352503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:36.364271 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1316/2663] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:36.368265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:36.378754 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de20e550-4e34-48a2-b121-bd51aa2170c8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:36.383349 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90912c10-89bb-4b40-b8ed-012cbd4c6490 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:36.383996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912c10-89bb-4b40-b8ed-012cbd4c6490 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.384280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912c10-89bb-4b40-b8ed-012cbd4c6490 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.384558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90912c10-89bb-4b40-b8ed-012cbd4c6490 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.385281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912c10-89bb-4b40-b8ed-012cbd4c6490 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:36.386914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90912c10-89bb-4b40-b8ed-012cbd4c6490 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:36.396501 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1348/2664] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:22:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:22:36.400290 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:36.410187 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc7d1c-e290-45d9-9e9e-a3773e972cf5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:36.414725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:36.415593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.415877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.416157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] PATH_INFO: `/v3/projects/a092326f9279428a867516a3b4241f82/users/bb026e4626e5457fb18f1221a085476f/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.430746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] RBAC: Authorizing `identity:create_grant(project_id=a092326f9279428a867516a3b4241f82, user_id=bb026e4626e5457fb18f1221a085476f, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:36.434123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:36.528193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1317/2665] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:22:36 2022] PUT /identity/v3/projects/a092326f9279428a867516a3b4241f82/users/bb026e4626e5457fb18f1221a085476f/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:36.538151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.538462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.538751 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.565701 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] MFA Rules not processed for user `bb026e4626e5457fb18f1221a085476f`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:36.566927 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:36.629045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1349/2666] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:36 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:36.640041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:36.641723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:36.696720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ffc79-2792-42d2-8e0e-fba440adafbe admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:36.700940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:36.701568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:36.701850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:36.702150 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:36.710236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:36.711653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:36.720282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1318/2667] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:36 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:40.570405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:40.571823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:40.584499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad35a6b-ce3f-459d-ba0b-943231978d0d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:40.588248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:40.588882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:40.592641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:40.592641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:40.592641 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:40.634276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:40.655535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:40.656969 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71474a02-b566-433b-9c0b-d05938a88f14 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:40.666519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1350/2668] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:40 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:22:46.716375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=86,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:47.841717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:47.914398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22e74f0d-3f76-4068-934c-cbd3fe50ff15 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:47.920490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:47.921610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:47.922074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:47.922521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] PATH_INFO: `/v3/users/bb026e4626e5457fb18f1221a085476f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:47.923954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb026e4626e5457fb18f1221a085476f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:47.925898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:48.138313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb026e4626e5457fb18f1221a085476f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.145190 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb026e4626e5457fb18f1221a085476f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.157362 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb026e4626e5457fb18f1221a085476f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.158157 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb026e4626e5457fb18f1221a085476f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.233399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb026e4626e5457fb18f1221a085476f'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.239654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1319/2669] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:22:47 2022] DELETE /identity/v3/users/bb026e4626e5457fb18f1221a085476f => generated 0 bytes in 398 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:48.244185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:48.249916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:48.249916 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:48.262690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:22:48.263905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:48.321537 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1351/2670] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:22:48.331326 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:48.332712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:48.389130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df8bd69-7e7b-4546-8477-219561e4b8e1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:48.392625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:48.393259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:48.393549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:48.393831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:48.403959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:48.405264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:48.415103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1320/2671] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:48.812264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:48.814399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:48.827612 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d9ac4f-26c2-463f-86ba-e25ec61822b0 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:48.832585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:48.834085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:48.834398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:48.834698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] PATH_INFO: `/v3/projects/a092326f9279428a867516a3b4241f82` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:48.836093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a092326f9279428a867516a3b4241f82)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:48.838053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:48.969991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a092326f9279428a867516a3b4241f82', 'request_id': 'req-4de05761-c3d2-416c-9c72-72e79fd8d7d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.975959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a092326f9279428a867516a3b4241f82', 'request_id': 'req-4de05761-c3d2-416c-9c72-72e79fd8d7d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:48.982798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a092326f9279428a867516a3b4241f82', 'request_id': 'req-4de05761-c3d2-416c-9c72-72e79fd8d7d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:49.072949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] The token cache is being invalidate because project a092326f9279428a867516a3b4241f82 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:22:49.072949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:49.072949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:22:49.072949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1352/2672] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:22:48 2022] DELETE /identity/v3/projects/a092326f9279428a867516a3b4241f82 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:22:58.411206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=79,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:22:58.458318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:22:58.466856 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a6b9bd4-46ad-4b0a-a4ac-b2f1594da192 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:22:58.515348 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:22:58.516033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:22:58.516317 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:22:58.516593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:22:58.518413 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:22:58.583196 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:22:58.584649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:22:58.595153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1321/2673] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:22:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 137 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:22:59.066445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=65,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:02.264726 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:02.267008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:02.280586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4de05761-c3d2-416c-9c72-72e79fd8d7d3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:02.285259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:02.286191 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:02.286475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:02.286781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] PATH_INFO: `/v3/users/5aa93da151774e5eaa092cdc5d445dba` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:02.287964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] RBAC: Authorizing `identity:delete_user(user_id=5aa93da151774e5eaa092cdc5d445dba)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:02.289874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:02.454598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5aa93da151774e5eaa092cdc5d445dba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:02.466075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5aa93da151774e5eaa092cdc5d445dba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:02.473009 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5aa93da151774e5eaa092cdc5d445dba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:02.473689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5aa93da151774e5eaa092cdc5d445dba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:02.544123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-87ec43b1-f033-4935-b880-444dca828b2c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5aa93da151774e5eaa092cdc5d445dba'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:02.551375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1353/2674] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:02 2022] DELETE /identity/v3/users/5aa93da151774e5eaa092cdc5d445dba => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:02.791322 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:02.806727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-814226d1-f731-4774-b5a5-5e990986adbb service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:02.865149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:02.866014 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:02.866336 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:02.866615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] PATH_INFO: `/v3/projects/32b0340ed2c94562826c27f8c34bab81` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:02.867792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] RBAC: Authorizing `identity:delete_project(project_id=32b0340ed2c94562826c27f8c34bab81)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:02.869749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:02.989360 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32b0340ed2c94562826c27f8c34bab81', 'request_id': 'req-fce68633-8ae5-41c4-98dc-f719fb7e68ec'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:02.991244 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:DELETE=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:02.995088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32b0340ed2c94562826c27f8c34bab81', 'request_id': 'req-fce68633-8ae5-41c4-98dc-f719fb7e68ec'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:03.001172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32b0340ed2c94562826c27f8c34bab81', 'request_id': 'req-fce68633-8ae5-41c4-98dc-f719fb7e68ec'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:03.096432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] The token cache is being invalidate because project 32b0340ed2c94562826c27f8c34bab81 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:03.096833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:03.097487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-fce68633-8ae5-41c4-98dc-f719fb7e68ec admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:03.099064 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1322/2675] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:02 2022] DELETE /identity/v3/projects/32b0340ed2c94562826c27f8c34bab81 => generated 0 bytes in 308 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:03.104114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.104408 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.104684 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.124399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:03.125610 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:03.206734 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1354/2676] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:03.212294 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.212582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.212862 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.231692 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:03.235260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:03.241491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1323/2677] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:23:03.245680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.255364 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ef9882f-6a0a-4cc4-ac3f-61eeb2743caf None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.259911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.261958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.261958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.261958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.261958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:03.262344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.263688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.275471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1355/2678] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:03.279597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.290359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76797d43-0665-4cfc-a00e-529a8b14ef9a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.299141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.299823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.300114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.300396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.301114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.303173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.395288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1324/2679] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:03 2022] POST /identity/v3/projects => generated 381 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:03.396548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.407274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49a6487e-23ee-4aca-aef9-1ee49d810433 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.464048 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.465007 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.465493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.465774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.466507 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.468497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.476079 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:03.583624 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1356/2680] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:03 2022] POST /identity/v3/users => generated 291 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:03.584916 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.595587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2075091-63ae-4a93-8039-9d60b39f1088 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.600459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.601131 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.601415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.601696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.602501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.604123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.615579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1325/2681] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:03.626262 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.637258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4623bfb-b099-418f-be59-d95afcd37384 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.642748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17255d67-8f33-4043-b64a-862a98584a7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.643448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255d67-8f33-4043-b64a-862a98584a7b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.643725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255d67-8f33-4043-b64a-862a98584a7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.644005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17255d67-8f33-4043-b64a-862a98584a7b admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.644735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255d67-8f33-4043-b64a-862a98584a7b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.646369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17255d67-8f33-4043-b64a-862a98584a7b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.657518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1357/2682] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:03.661723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.672409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f572562-e22a-4061-a308-1b3ad1af5a57 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.677114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.678265 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.678551 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.678833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] PATH_INFO: `/v3/projects/40362f3810dd41b1ad9818e8d812ac2d/users/d9c7a3c4eff04d229a06506af2e07fbc/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.694963 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=40362f3810dd41b1ad9818e8d812ac2d, user_id=d9c7a3c4eff04d229a06506af2e07fbc, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.697543 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.777255 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1326/2683] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:03 2022] PUT /identity/v3/projects/40362f3810dd41b1ad9818e8d812ac2d/users/d9c7a3c4eff04d229a06506af2e07fbc/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:03.789291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.789642 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.789848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.817404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] MFA Rules not processed for user `d9c7a3c4eff04d229a06506af2e07fbc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:03.821386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:03.883908 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1358/2684] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:03 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:03.888301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.949825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc0b961b-cf1c-4263-bdc8-95ca41b050e5 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.955106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.955754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.956039 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.956312 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:03.957006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:03.958951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:03.974817 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:03.976611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:03.992637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd220a8-7eea-4960-8621-531db2eb3d98 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:03.997359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:03.998254 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:03.998542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:03.998823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] PATH_INFO: `/v3/users/95d0a4c494e149629ab3cc4031f08bdd` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.000073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] RBAC: Authorizing `identity:delete_user(user_id=95d0a4c494e149629ab3cc4031f08bdd)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.001991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.060046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1327/2685] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:03 2022] POST /identity/v3/projects => generated 379 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:04.064109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.126123 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f37a110-d15c-4852-8d25-de4cd81936d0 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.131027 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.131729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.132016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.132298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.132987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.134945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.143774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=93,keystone:DELETE=2,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:04.170251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '95d0a4c494e149629ab3cc4031f08bdd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.184399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '95d0a4c494e149629ab3cc4031f08bdd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.191638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '95d0a4c494e149629ab3cc4031f08bdd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.192354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '95d0a4c494e149629ab3cc4031f08bdd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.233576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1328/2686] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:04 2022] POST /identity/v3/users => generated 296 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:04.237576 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.247286 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3f57164-8df1-4f56-84db-dde565cbf03f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.250525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '95d0a4c494e149629ab3cc4031f08bdd'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.252925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.253585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.253866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.254200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.254932 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.256642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.257542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1359/2687] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:03 2022] DELETE /identity/v3/users/95d0a4c494e149629ab3cc4031f08bdd => generated 0 bytes in 283 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:04.268458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1329/2688] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:23:04.272244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.273723 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:04.318114 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:04.339807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3112f6c8-100e-43ff-97e5-fd726e0f0262 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.344873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.345763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.346298 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.346440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] PATH_INFO: `/v3/projects/10ccb0e3a20c40f49d508710155c01d7/users/40d7b93fcd3148458c9fac41697e20e9/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.360794 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ccb0e3a20c40f49d508710155c01d7, user_id=40d7b93fcd3148458c9fac41697e20e9, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.363808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.457376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1360/2689] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:04 2022] PUT /identity/v3/projects/10ccb0e3a20c40f49d508710155c01d7/users/40d7b93fcd3148458c9fac41697e20e9/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:04.461308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.471260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-167d99e7-2a3a-423e-886b-5bbf01eaf1ce admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.525913 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.526481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.526763 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.527037 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.527814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.529399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.540685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1330/2690] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:04 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:04.544685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.546157 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.548210 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:04.555553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19529e4e-8b5c-4bd6-b7cc-14538b0e545e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.560497 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79cccbd3-15d9-4dc5-857d-921909e16c08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.561416 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccbd3-15d9-4dc5-857d-921909e16c08 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.561956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccbd3-15d9-4dc5-857d-921909e16c08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.563015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cccbd3-15d9-4dc5-857d-921909e16c08 admin admin] PATH_INFO: `/v3/projects/10ccb0e3a20c40f49d508710155c01d7/users/40d7b93fcd3148458c9fac41697e20e9/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.565135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cccbd3-15d9-4dc5-857d-921909e16c08 admin admin] RBAC: Authorizing `identity:create_grant(project_id=10ccb0e3a20c40f49d508710155c01d7, user_id=40d7b93fcd3148458c9fac41697e20e9, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.568007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79cccbd3-15d9-4dc5-857d-921909e16c08 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.573013 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076f764f-2d0e-45bf-a6f0-ee101a871776 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.582064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.582064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.582064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.582064 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] PATH_INFO: `/v3/projects/d35dc97ba8d8474c89fcfc3e86bb0fae` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.582703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d35dc97ba8d8474c89fcfc3e86bb0fae)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.583698 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1331/2691] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:04 2022] PUT /identity/v3/projects/10ccb0e3a20c40f49d508710155c01d7/users/40d7b93fcd3148458c9fac41697e20e9/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 39 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:04.584644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.593915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.594230 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.594511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.621522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] MFA Rules not processed for user `40d7b93fcd3148458c9fac41697e20e9`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:04.622812 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:04.689572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1332/2692] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:04 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:23:04.700860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.702215 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:04.727068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd35dc97ba8d8474c89fcfc3e86bb0fae', 'request_id': 'req-ccad4722-498f-4c4d-bff2-069741eac3c6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.732948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd35dc97ba8d8474c89fcfc3e86bb0fae', 'request_id': 'req-ccad4722-498f-4c4d-bff2-069741eac3c6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.740104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd35dc97ba8d8474c89fcfc3e86bb0fae', 'request_id': 'req-ccad4722-498f-4c4d-bff2-069741eac3c6'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.755718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:04.759516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c935d611-487b-408b-91fb-f2d4a145f79f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.806376 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] The token cache is being invalidate because project d35dc97ba8d8474c89fcfc3e86bb0fae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:04.806591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.806836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.807083 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.807364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.807471 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:04.807638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.809091 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1361/2693] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:04 2022] DELETE /identity/v3/projects/d35dc97ba8d8474c89fcfc3e86bb0fae => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:04.810359 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:04.813448 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:04.814999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:04.876458 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.877823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:04.882146 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccad4722-498f-4c4d-bff2-069741eac3c6 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:04.886836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:04.887703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:04.887986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:04.893465 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] PATH_INFO: `/v3/users/5b7c0918a34e480eac23a929032631d3` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:04.893779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1333/2694] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:04 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 188 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:23:04.894263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b7c0918a34e480eac23a929032631d3)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:04.894263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:05.071205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b7c0918a34e480eac23a929032631d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.076836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=84,keystone:INSERT=2,keystone:DELETE=14 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:05.083560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:05.083834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b7c0918a34e480eac23a929032631d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.085067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:05.090666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b7c0918a34e480eac23a929032631d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.091518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b7c0918a34e480eac23a929032631d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.096197 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebfd5ed4-89be-4a19-992f-6a75feb142f4 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:05.099825 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:05.100469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:05.100748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:05.101025 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:05.102779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:05.161102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:05.162503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:05.170604 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7d5286b0-504f-436c-be7a-ebee6e2d97ad admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b7c0918a34e480eac23a929032631d3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.171343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1334/2695] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:05 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:23:05.178855 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1362/2696] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:04 2022] DELETE /identity/v3/users/5b7c0918a34e480eac23a929032631d3 => generated 0 bytes in 366 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:23:05.426489 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:05.437723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d010ab-fabd-4873-a6ac-547e1c677abe service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:05.494804 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:05.503562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:05.504422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:05.504707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:05.505055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] PATH_INFO: `/v3/projects/d14191b4a27049a0a88fbbd6b4ea7f46` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:05.507017 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] RBAC: Authorizing `identity:delete_project(project_id=d14191b4a27049a0a88fbbd6b4ea7f46)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:05.510798 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:05.622570 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd14191b4a27049a0a88fbbd6b4ea7f46', 'request_id': 'req-76540ff5-5d42-4adf-91fb-bbfbc42a21db'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.628421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd14191b4a27049a0a88fbbd6b4ea7f46', 'request_id': 'req-76540ff5-5d42-4adf-91fb-bbfbc42a21db'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.634742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd14191b4a27049a0a88fbbd6b4ea7f46', 'request_id': 'req-76540ff5-5d42-4adf-91fb-bbfbc42a21db'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.701480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] The token cache is being invalidate because project d14191b4a27049a0a88fbbd6b4ea7f46 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:05.701769 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.702395 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-76540ff5-5d42-4adf-91fb-bbfbc42a21db admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:05.704491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1335/2697] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:05 2022] DELETE /identity/v3/projects/d14191b4a27049a0a88fbbd6b4ea7f46 => generated 0 bytes in 279 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:05.710586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:05.711056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:05.711156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:05.728983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:05.730234 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:05.788934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1363/2698] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:05.797211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:05.797590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:05.797882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:05.816430 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:05.817640 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:05.825591 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1336/2699] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:05.830249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:05.840307 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915fbe87-bc1e-4e34-81ff-2e78a75f30f1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:05.845205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:05.845857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:05.846174 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:05.846451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:05.847173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:05.847481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:05.849062 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:05.860494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1364/2700] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:05.864849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:05.874040 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02e5b181-5965-4acd-b289-27f7d22ba997 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:05.879130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:05.879800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:05.880082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:05.880357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:05.881046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:05.882976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:05.956976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1337/2701] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:05 2022] POST /identity/v3/projects => generated 385 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:05.960949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:05.970878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c2ddab-60a1-4743-890e-c2b7e4670b78 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.025892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.026588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.026874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.027154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.027835 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.029742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.115357 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1365/2702] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:05 2022] POST /identity/v3/users => generated 293 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:06.119465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.130339 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8232076-5387-4724-87d3-2dfb36894181 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.134878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.135528 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.135807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.136080 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.136801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.138454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.149256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1338/2703] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:06.153991 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.164058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad335c7-e39a-4ad3-b40d-cb076c3fa981 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.168668 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e532b013-414b-45c9-8de7-416408dc124d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.169363 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532b013-414b-45c9-8de7-416408dc124d admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.169646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532b013-414b-45c9-8de7-416408dc124d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.169922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e532b013-414b-45c9-8de7-416408dc124d admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.170679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532b013-414b-45c9-8de7-416408dc124d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.172294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e532b013-414b-45c9-8de7-416408dc124d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.182001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1366/2704] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:06.185903 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.196284 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44b26486-4cbb-4074-9411-a2d2316b06c7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.200905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.201771 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.202093 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.202378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] PATH_INFO: `/v3/projects/7886527fb42b481db33063d13c5475a1/users/d320e21fd85846d68264784ffab9ba0e/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.220069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] RBAC: Authorizing `identity:create_grant(project_id=7886527fb42b481db33063d13c5475a1, user_id=d320e21fd85846d68264784ffab9ba0e, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.220069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.295805 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1339/2705] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:06 2022] PUT /identity/v3/projects/7886527fb42b481db33063d13c5475a1/users/d320e21fd85846d68264784ffab9ba0e/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:06.306415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.306731 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.307005 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.333857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] MFA Rules not processed for user `d320e21fd85846d68264784ffab9ba0e`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:06.335104 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:06.353072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:06.398588 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1367/2706] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:06.403043 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.464352 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9006eb00-33e2-40b4-b968-389f9ad015fb admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.469082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.469737 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.470020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.470390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.471019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.472926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.551853 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1340/2707] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:06 2022] POST /identity/v3/projects => generated 383 bytes in 149 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:06.555688 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.568801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99880fc3-a217-4bd7-80c5-8a482942c5a2 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.630808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.631480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.631763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.632043 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.632747 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.634694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.713534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1368/2708] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:06 2022] POST /identity/v3/users => generated 298 bytes in 155 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:06.714742 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.722010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:06.725954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aac0bb63-083e-4703-9ef2-10ae131c8a5c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.730811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.731477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.731767 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.732065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.732802 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.735277 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.746211 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1341/2709] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:06.751253 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.762394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8bbd23f-0d75-4cea-842e-e28030fe9e02 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.769719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.770645 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.770929 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.771208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] PATH_INFO: `/v3/projects/6e7a01b34e124dd484fc634ae7c90f98/users/4377c932032f4f2c9b4ac5e8cd5da467/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.786853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a01b34e124dd484fc634ae7c90f98, user_id=4377c932032f4f2c9b4ac5e8cd5da467, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.792133 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.853391 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1369/2710] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:06 2022] PUT /identity/v3/projects/6e7a01b34e124dd484fc634ae7c90f98/users/4377c932032f4f2c9b4ac5e8cd5da467/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:06.857408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.868470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bf93a8-beb0-4a0a-abb1-777ff4dc67b1 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.925419 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39fd08c4-e2bc-4ea3-945f-ec38a26757a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.926109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd08c4-e2bc-4ea3-945f-ec38a26757a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.926393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd08c4-e2bc-4ea3-945f-ec38a26757a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.926667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39fd08c4-e2bc-4ea3-945f-ec38a26757a6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.927387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd08c4-e2bc-4ea3-945f-ec38a26757a6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.929029 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39fd08c4-e2bc-4ea3-945f-ec38a26757a6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.939248 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1342/2711] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:06.943467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:06.954764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32c6d14-af17-4529-8fb9-5b9bd719a04a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:06.959569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:06.960450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.960766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.961045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] PATH_INFO: `/v3/projects/6e7a01b34e124dd484fc634ae7c90f98/users/4377c932032f4f2c9b4ac5e8cd5da467/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:06.963072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] RBAC: Authorizing `identity:create_grant(project_id=6e7a01b34e124dd484fc634ae7c90f98, user_id=4377c932032f4f2c9b4ac5e8cd5da467, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:06.965859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:06.977938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1370/2712] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:06 2022] PUT /identity/v3/projects/6e7a01b34e124dd484fc634ae7c90f98/users/4377c932032f4f2c9b4ac5e8cd5da467/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:06.993631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:06.994186 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:06.994314 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:07.022795 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] MFA Rules not processed for user `4377c932032f4f2c9b4ac5e8cd5da467`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:07.024013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:07.092977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1343/2713] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:06 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:07.104375 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:07.107219 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:07.164629 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba39b5b9-c1ec-4909-847e-a690ec8dd65f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:07.168235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:07.168873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:07.169154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:07.169426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:07.195309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:07.225480 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:07.227030 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:07.235922 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1371/2714] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:07 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:12.354251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:12.355760 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:12.368288 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28bbb625-95c4-42d1-ada1-93899d7bd9b1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:12.371850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c4877f-4278-43a8-94a5-b4819fe00088 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:12.372477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4877f-4278-43a8-94a5-b4819fe00088 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:12.372756 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4877f-4278-43a8-94a5-b4819fe00088 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:12.373028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c4877f-4278-43a8-94a5-b4819fe00088 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:12.382834 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4877f-4278-43a8-94a5-b4819fe00088 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:12.384301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c4877f-4278-43a8-94a5-b4819fe00088 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:12.393843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1344/2715] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:12 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:13.700853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:13.702264 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:13.768267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef5d350a-8c66-4cfa-a221-1e1de964424d service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:13.772860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:13.773735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:13.774022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:13.774330 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] PATH_INFO: `/v3/users/d9c7a3c4eff04d229a06506af2e07fbc` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:13.775611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d9c7a3c4eff04d229a06506af2e07fbc)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:13.777693 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:14.032965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd9c7a3c4eff04d229a06506af2e07fbc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.045266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd9c7a3c4eff04d229a06506af2e07fbc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.052978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd9c7a3c4eff04d229a06506af2e07fbc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.053679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd9c7a3c4eff04d229a06506af2e07fbc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.155194 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd9c7a3c4eff04d229a06506af2e07fbc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.162182 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1372/2716] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:13 2022] DELETE /identity/v3/users/d9c7a3c4eff04d229a06506af2e07fbc => generated 0 bytes in 462 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:14.166618 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811516ce-a390-4853-beb3-87f3073c434f None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:14.167132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811516ce-a390-4853-beb3-87f3073c434f None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:14.167346 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811516ce-a390-4853-beb3-87f3073c434f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:14.188672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-811516ce-a390-4853-beb3-87f3073c434f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:14.189922 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-811516ce-a390-4853-beb3-87f3073c434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:14.247723 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1345/2717] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:14 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:14.257743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:14.259417 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:14.312619 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:14.318594 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d9046e-2e90-44eb-bfcf-185003deb767 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:14.321829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:14.322513 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:14.322796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:14.323070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:14.332403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:14.333854 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:14.344272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1373/2718] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:14 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:14.768775 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811516ce-a390-4853-beb3-87f3073c434f None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:14.770405 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-811516ce-a390-4853-beb3-87f3073c434f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:14.777822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:14.783663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811516ce-a390-4853-beb3-87f3073c434f None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:14.789262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:14.790289 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:14.790641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:14.790996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] PATH_INFO: `/v3/projects/40362f3810dd41b1ad9818e8d812ac2d` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:14.792422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] RBAC: Authorizing `identity:delete_project(project_id=40362f3810dd41b1ad9818e8d812ac2d)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:14.794390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:14.944307 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '40362f3810dd41b1ad9818e8d812ac2d', 'request_id': 'req-623d0152-3a60-4f93-8368-902c3a2ba4ac'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.949657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '40362f3810dd41b1ad9818e8d812ac2d', 'request_id': 'req-623d0152-3a60-4f93-8368-902c3a2ba4ac'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:14.956392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '40362f3810dd41b1ad9818e8d812ac2d', 'request_id': 'req-623d0152-3a60-4f93-8368-902c3a2ba4ac'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.055387 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] The token cache is being invalidate because project 40362f3810dd41b1ad9818e8d812ac2d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:15.055758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.056421 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.057992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1346/2719] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:14 2022] DELETE /identity/v3/projects/40362f3810dd41b1ad9818e8d812ac2d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:15.062068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:15.072140 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2e2506d-735f-454a-bb15-339cd656b6b1 service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:15.128843 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:15.129711 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:15.130012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:15.130334 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] PATH_INFO: `/v3/users/40d7b93fcd3148458c9fac41697e20e9` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:15.131522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] RBAC: Authorizing `identity:delete_user(user_id=40d7b93fcd3148458c9fac41697e20e9)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:15.133436 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:15.303631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '40d7b93fcd3148458c9fac41697e20e9'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.315985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '40d7b93fcd3148458c9fac41697e20e9'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.322680 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '40d7b93fcd3148458c9fac41697e20e9'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.323346 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '40d7b93fcd3148458c9fac41697e20e9'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.386947 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-673e49a0-0ee5-4173-a8bc-7a348ecfbe93 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '40d7b93fcd3148458c9fac41697e20e9'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:15.393085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1374/2720] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:15 2022] DELETE /identity/v3/users/40d7b93fcd3148458c9fac41697e20e9 => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:15.922722 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:15.924224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:15.938240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-623d0152-3a60-4f93-8368-902c3a2ba4ac admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:15.997809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:15.998703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:15.998983 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:15.999258 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] PATH_INFO: `/v3/projects/10ccb0e3a20c40f49d508710155c01d7` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.000433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10ccb0e3a20c40f49d508710155c01d7)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.002417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.138897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10ccb0e3a20c40f49d508710155c01d7', 'request_id': 'req-d219d680-3346-4386-9ef1-efc583fc12d2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:16.144744 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10ccb0e3a20c40f49d508710155c01d7', 'request_id': 'req-d219d680-3346-4386-9ef1-efc583fc12d2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:16.151636 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10ccb0e3a20c40f49d508710155c01d7', 'request_id': 'req-d219d680-3346-4386-9ef1-efc583fc12d2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:16.223801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] The token cache is being invalidate because project 10ccb0e3a20c40f49d508710155c01d7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:16.224091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:16.224707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d219d680-3346-4386-9ef1-efc583fc12d2 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:16.226345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1347/2721] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:15 2022] DELETE /identity/v3/projects/10ccb0e3a20c40f49d508710155c01d7 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:16.231163 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.231671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.231797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.249345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:16.250576 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:16.309535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1375/2722] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:16.317792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.318122 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.318445 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.337254 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:16.338484 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:16.346622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1348/2723] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:16.350971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:16.360582 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e7acf5-fb18-4468-8ac6-40f406e91375 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:16.365574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:16.366256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.366543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.366848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.367573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:16.367880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.369555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.371995 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:16.382149 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1376/2724] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:16.386481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:16.396414 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e412fd43-a77f-4ff7-94a1-0304dd2630be None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:16.401088 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:16.401731 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.402016 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.402329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.403028 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.404920 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.408988 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:16.493372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1349/2725] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:16 2022] POST /identity/v3/projects => generated 373 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:16.497545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:16.508630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16af3b37-299d-43d7-84ee-81b83647a20b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:16.562531 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:16.563199 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.563483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.563760 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.564990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.566944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.675796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1377/2726] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:16 2022] POST /identity/v3/users => generated 287 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:16.679787 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:16.691140 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13741021-a5dd-410c-8818-ed74ab9275ad admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:16.695663 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:16.696313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.696597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.696931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.697633 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.699241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.709263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1350/2727] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:16.713514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:16.723059 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6b71aca-2b63-4717-ac64-aa99409f95f3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:16.727638 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3656496-21f9-47e7-b438-0b982056b238 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:16.728286 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656496-21f9-47e7-b438-0b982056b238 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.728569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656496-21f9-47e7-b438-0b982056b238 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.728846 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3656496-21f9-47e7-b438-0b982056b238 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.729569 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656496-21f9-47e7-b438-0b982056b238 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.731202 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3656496-21f9-47e7-b438-0b982056b238 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.742510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1378/2728] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:16 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:16.746455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:16.757033 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3cc947-780f-4039-b3eb-e9696fb20c13 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:16.762437 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:16.763316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.763605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.763889 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] PATH_INFO: `/v3/projects/c04323b16303498a93705bbe7f80271b/users/d68b358dc8944f258f4a6b0a5f2a46ec/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.778654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] RBAC: Authorizing `identity:create_grant(project_id=c04323b16303498a93705bbe7f80271b, user_id=d68b358dc8944f258f4a6b0a5f2a46ec, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:16.781411 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:16.846778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1351/2729] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:16 2022] PUT /identity/v3/projects/c04323b16303498a93705bbe7f80271b/users/d68b358dc8944f258f4a6b0a5f2a46ec/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:16.857989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:16.858310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:16.858590 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:16.884341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] MFA Rules not processed for user `d68b358dc8944f258f4a6b0a5f2a46ec`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:16.885553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:16.953795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1379/2730] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:16 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:23:16.959877 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.020687 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1d55f8-b333-4da3-b790-2b112e6f53bb admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.025593 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.026278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.026560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.026836 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.027533 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.029522 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.138302 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1352/2731] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:16 2022] POST /identity/v3/projects => generated 375 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:17.140070 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.151586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14714ae2-8ba2-4753-840b-048fe68921ea None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.208623 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.209221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.209504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.209781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.210504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.212433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.221195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:17.344757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1380/2732] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:17 2022] POST /identity/v3/users => generated 294 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:17.348545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.359379 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da5de9e-7849-4436-8b17-5897af2a7cb6 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.364706 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.365390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.365700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.365976 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.366732 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.368374 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.379779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1353/2733] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:17.383893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.393702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88f8ba52-7ebd-445f-bafa-2eaf394471c2 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.398369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.399248 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.405066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.405066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] PATH_INFO: `/v3/projects/7b63552ca69e4f4aa63c3914c17772a7/users/10f6a42212734f8dba4d97fece673ab2/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.414344 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b63552ca69e4f4aa63c3914c17772a7, user_id=10f6a42212734f8dba4d97fece673ab2, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.416993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.521583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1381/2734] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:17 2022] PUT /identity/v3/projects/7b63552ca69e4f4aa63c3914c17772a7/users/10f6a42212734f8dba4d97fece673ab2/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:17.525582 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.536498 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e57c7f7b-8f20-49bf-9331-bb619497319e admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.592837 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e293a5-fe73-4e28-9ebe-a837342cb5c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.593538 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e293a5-fe73-4e28-9ebe-a837342cb5c5 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.593824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e293a5-fe73-4e28-9ebe-a837342cb5c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.594133 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e293a5-fe73-4e28-9ebe-a837342cb5c5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.594860 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e293a5-fe73-4e28-9ebe-a837342cb5c5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.596469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e293a5-fe73-4e28-9ebe-a837342cb5c5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.606896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1354/2735] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:17 2022] GET /identity/v3/roles => generated 1420 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:17.611265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.621370 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac381cd-bdf8-48fd-9f52-01e57417a30a admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.625936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.626832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.627116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.627396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] PATH_INFO: `/v3/projects/7b63552ca69e4f4aa63c3914c17772a7/users/10f6a42212734f8dba4d97fece673ab2/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.629340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b63552ca69e4f4aa63c3914c17772a7, user_id=10f6a42212734f8dba4d97fece673ab2, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.632082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.642458 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1382/2736] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:17 2022] PUT /identity/v3/projects/7b63552ca69e4f4aa63c3914c17772a7/users/10f6a42212734f8dba4d97fece673ab2/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:17.652904 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.653253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.653560 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.680748 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] MFA Rules not processed for user `10f6a42212734f8dba4d97fece673ab2`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:17.681975 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:17.691098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:17.748872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1355/2737] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:17 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:17.760267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:17.767327 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:17.818618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8116068d-fa78-4d10-9d5c-b1fe53e8f1f1 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:17.822258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fd384-9ae2-4524-b4d8-4593f832a071 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:17.822919 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd384-9ae2-4524-b4d8-4593f832a071 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:17.823200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd384-9ae2-4524-b4d8-4593f832a071 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:17.823477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fd384-9ae2-4524-b4d8-4593f832a071 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:17.878280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd384-9ae2-4524-b4d8-4593f832a071 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:17.879724 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8fd384-9ae2-4524-b4d8-4593f832a071 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:17.889510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1383/2738] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:17 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 130 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:18.178009 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:18.179562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:18.242432 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf109b8-1cc0-4acb-92d0-184eef4e0720 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:18.246867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:18.247724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:18.248006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:18.248281 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] PATH_INFO: `/v3/users/d320e21fd85846d68264784ffab9ba0e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:18.249449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d320e21fd85846d68264784ffab9ba0e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:18.251422 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:18.465260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd320e21fd85846d68264784ffab9ba0e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:18.471900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd320e21fd85846d68264784ffab9ba0e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:18.484929 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd320e21fd85846d68264784ffab9ba0e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:18.485677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd320e21fd85846d68264784ffab9ba0e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:18.560933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd320e21fd85846d68264784ffab9ba0e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:18.567564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1356/2739] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:18 2022] DELETE /identity/v3/users/d320e21fd85846d68264784ffab9ba0e => generated 0 bytes in 391 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:18.572565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:18.573018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:18.573018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:18.589618 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:18.590845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:18.653852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1384/2740] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:18.663964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:18.676789 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:18.696569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:18.721827 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f4441c-7e88-4b70-9ac3-62e4dc57ea04 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:18.725845 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:18.726509 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:18.726792 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:18.727069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:18.736298 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:18.737813 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:18.748132 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1357/2741] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:19.232017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:19.233553 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:19.246089 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-310f5119-96cf-450f-8365-f2adb2580c91 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:19.251369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:19.251659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:19.251941 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:19.252235 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] PATH_INFO: `/v3/projects/7886527fb42b481db33063d13c5475a1` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:19.253477 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7886527fb42b481db33063d13c5475a1)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:19.255961 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:19.263321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:19.367586 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7886527fb42b481db33063d13c5475a1', 'request_id': 'req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.373012 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7886527fb42b481db33063d13c5475a1', 'request_id': 'req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.379523 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7886527fb42b481db33063d13c5475a1', 'request_id': 'req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.468558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] The token cache is being invalidate because project 7886527fb42b481db33063d13c5475a1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:19.468848 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.469518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.471181 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1385/2742] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:19 2022] DELETE /identity/v3/projects/7886527fb42b481db33063d13c5475a1 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:19.475179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:19.484900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-124220bd-b376-4d8f-95bc-7790c98c0bfa service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:19.543823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:19.544624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:19.544909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:19.545188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] PATH_INFO: `/v3/users/4377c932032f4f2c9b4ac5e8cd5da467` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:19.550653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4377c932032f4f2c9b4ac5e8cd5da467)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:19.550653 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:19.777917 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4377c932032f4f2c9b4ac5e8cd5da467'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.784801 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4377c932032f4f2c9b4ac5e8cd5da467'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.796469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4377c932032f4f2c9b4ac5e8cd5da467'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.797077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4377c932032f4f2c9b4ac5e8cd5da467'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.880919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-25a07b8a-70c3-472a-a199-47a5c4465cc7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4377c932032f4f2c9b4ac5e8cd5da467'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:19.887323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1358/2743] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:19 2022] DELETE /identity/v3/users/4377c932032f4f2c9b4ac5e8cd5da467 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:23:20.502217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:20.504978 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:20.521681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b6c0c5-b4fb-42d5-8bb8-1003e01c78fc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:20.578727 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:20.579912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:20.579912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:20.580185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] PATH_INFO: `/v3/projects/6e7a01b34e124dd484fc634ae7c90f98` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:20.581369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] RBAC: Authorizing `identity:delete_project(project_id=6e7a01b34e124dd484fc634ae7c90f98)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:20.583281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:20.715562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6e7a01b34e124dd484fc634ae7c90f98', 'request_id': 'req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:20.720966 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6e7a01b34e124dd484fc634ae7c90f98', 'request_id': 'req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:20.727541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6e7a01b34e124dd484fc634ae7c90f98', 'request_id': 'req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:20.788986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] The token cache is being invalidate because project 6e7a01b34e124dd484fc634ae7c90f98 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:20.789276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:20.789889 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-13816d2c-8ad9-415b-b3ed-62fd7a97d80f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:20.791487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1386/2744] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:20 2022] DELETE /identity/v3/projects/6e7a01b34e124dd484fc634ae7c90f98 => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:20.797577 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:20.798073 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:20.798185 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:20.816925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:20.818180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:20.861301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:20.876590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1359/2745] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:20.938185 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:20.938475 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:20.938755 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:20.956799 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:20.957996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:20.966120 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1387/2746] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:20.970364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:20.980693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2d244f4-aeee-4d9c-9e93-7eebe89dc89d None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:20.985246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:20.986206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:20.986494 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:20.986776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:20.987506 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:20.987817 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:20.989453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.001495 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1360/2747] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:21.005831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.015206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d79cf78d-30cd-4511-94d3-513854ff748d None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.019859 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.020503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.020784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.021066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.021762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.023703 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.037716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:21.128135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.129876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:21.180491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1388/2748] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:21 2022] POST /identity/v3/projects => generated 359 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:21.181447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.192480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-444741bf-1a1d-4e03-9144-1288a0b6f2a0 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.241642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.242323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.242610 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.242888 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.243716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d1f8e60-0a6d-40a6-9d26-31df45f789b7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.244765 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:21.248702 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.249447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.250162 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.250463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.251425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.253844 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.308850 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.310330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.320214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1361/2749] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:21 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:23:21.327326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1389/2750] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:21 2022] POST /identity/v3/users => generated 280 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:21.331451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.342435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d6aa037-297f-46dd-9f31-e0307fcd68b8 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.347227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.352630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.352630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.352630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.352630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.352630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.361719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1362/2751] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:21.365753 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.375743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-234a9697-07ad-4cb7-8c01-9a913adc7f00 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.380432 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f73eb2ba-4eb2-4382-9c9a-f83c907521d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.385081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb2ba-4eb2-4382-9c9a-f83c907521d7 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.385081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb2ba-4eb2-4382-9c9a-f83c907521d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.385081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f73eb2ba-4eb2-4382-9c9a-f83c907521d7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.385081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eb2ba-4eb2-4382-9c9a-f83c907521d7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.385081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f73eb2ba-4eb2-4382-9c9a-f83c907521d7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.393719 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1390/2752] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:21 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:23:21.398146 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.407914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26279f66-baa6-407a-811d-0a9efc7b986c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.413120 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.419573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.419573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.419573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] PATH_INFO: `/v3/projects/a54a20a77aa84f668249132a41f1aa6b/users/ac709480eee44748b4a3f57c42fab41b/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.428919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] RBAC: Authorizing `identity:create_grant(project_id=a54a20a77aa84f668249132a41f1aa6b, user_id=ac709480eee44748b4a3f57c42fab41b, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.431621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.515609 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1363/2753] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:21 2022] PUT /identity/v3/projects/a54a20a77aa84f668249132a41f1aa6b/users/ac709480eee44748b4a3f57c42fab41b/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:21.527406 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.527867 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.527963 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.555792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] MFA Rules not processed for user `ac709480eee44748b4a3f57c42fab41b`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:21.556335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:21.621617 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1391/2754] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:21 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:21.659067 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.660774 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:21.670972 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:21.719216 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574f578a-bb46-4e07-b40d-ec46346e4ebd admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.723005 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d35f087a-7ff2-4275-9a88-615cd236f5db service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.723650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f087a-7ff2-4275-9a88-615cd236f5db service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.723939 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f087a-7ff2-4275-9a88-615cd236f5db service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.724222 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d35f087a-7ff2-4275-9a88-615cd236f5db service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.732874 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f087a-7ff2-4275-9a88-615cd236f5db service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.734337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d35f087a-7ff2-4275-9a88-615cd236f5db service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.744053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1364/2755] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:21 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:21.758245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:21.821024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171ba09d-02e1-486c-b43d-82f79e1835c4 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:21.825682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:21.826570 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:21.826858 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:21.827134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] PATH_INFO: `/v3/users/ac709480eee44748b4a3f57c42fab41b` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:21.828328 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ac709480eee44748b4a3f57c42fab41b)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:21.830276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:21.835022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:22.030263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ac709480eee44748b4a3f57c42fab41b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.042058 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ac709480eee44748b4a3f57c42fab41b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.048748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ac709480eee44748b4a3f57c42fab41b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.049387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ac709480eee44748b4a3f57c42fab41b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.109425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ac709480eee44748b4a3f57c42fab41b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.116382 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1392/2756] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:21 2022] DELETE /identity/v3/users/ac709480eee44748b4a3f57c42fab41b => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:22.120923 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:22.121384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:22.121492 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:22.140449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:22.141740 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:22.199353 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1365/2757] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:22.208985 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:22.210462 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:22.268206 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7595408c-5485-425f-b049-0cc95018adb2 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:22.271869 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d3569b7-eb27-4049-a8eb-34343314884d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:22.272515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3569b7-eb27-4049-a8eb-34343314884d service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:22.272797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3569b7-eb27-4049-a8eb-34343314884d service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:22.273075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d3569b7-eb27-4049-a8eb-34343314884d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:22.282221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3569b7-eb27-4049-a8eb-34343314884d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:22.283634 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d3569b7-eb27-4049-a8eb-34343314884d service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:22.293713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1393/2758] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:22.721807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:22.723262 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:22.736572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4631ef56-e2fb-4e2e-a57c-c3700c96ba05 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:22.742010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:22.742965 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:22.743250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:22.743534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] PATH_INFO: `/v3/projects/a54a20a77aa84f668249132a41f1aa6b` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:22.748060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a54a20a77aa84f668249132a41f1aa6b)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:22.748060 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:22.869325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a54a20a77aa84f668249132a41f1aa6b', 'request_id': 'req-52256ffc-0494-4e38-9a72-53cfb7fac076'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.874784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a54a20a77aa84f668249132a41f1aa6b', 'request_id': 'req-52256ffc-0494-4e38-9a72-53cfb7fac076'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.880905 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a54a20a77aa84f668249132a41f1aa6b', 'request_id': 'req-52256ffc-0494-4e38-9a72-53cfb7fac076'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.954296 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] The token cache is being invalidate because project a54a20a77aa84f668249132a41f1aa6b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:22.954594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.955201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-52256ffc-0494-4e38-9a72-53cfb7fac076 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:22.956779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1366/2759] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:22 2022] DELETE /identity/v3/projects/a54a20a77aa84f668249132a41f1aa6b => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:22.962291 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:22.962795 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:22.962905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:22.979893 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:22.981087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:23.039960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1394/2760] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:23.050247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.050247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.050247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.068566 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:23.069779 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:23.077809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1367/2761] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:23.082098 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.092315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75affcea-b9b9-46c5-a0e2-b233e582a945 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.096964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.097647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.097933 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.098244 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.098976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:23.099807 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.101404 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.113393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1395/2762] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Jul 06 17:23:23.118399 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.127725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a367935-e38c-41ad-a67c-9f8d6c26ac3a None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.132417 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.133065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.133351 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.133632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.134390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.136297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.233061 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1368/2763] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:23 2022] POST /identity/v3/projects => generated 385 bytes in 112 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:23.234336 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.245666 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9844b41d-ead5-46a9-9333-4155565a2a09 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.254777 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:23.308389 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.309068 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.309351 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.309630 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.310365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.312343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.381681 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1396/2764] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:23 2022] POST /identity/v3/users => generated 293 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:23.387247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.394019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:23.398338 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0db60bb4-37b8-4e6a-9532-2a3337968863 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.402969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.403703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.403987 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.404264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.404989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.406659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.418068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1369/2765] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:23.421987 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.431958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6833ce15-0edc-4c32-975d-1e1be28908f8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.436611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2a7f268-3558-43e2-9908-c0fbf092055b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.437267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f268-3558-43e2-9908-c0fbf092055b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.437628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f268-3558-43e2-9908-c0fbf092055b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.437882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2a7f268-3558-43e2-9908-c0fbf092055b admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.438650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f268-3558-43e2-9908-c0fbf092055b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.442259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2a7f268-3558-43e2-9908-c0fbf092055b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.450259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1397/2766] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:23 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:23.454154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.464376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8869f37b-be74-45d7-9b7a-fc91b76891be admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.468969 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.477520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.477520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.477520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] PATH_INFO: `/v3/projects/a235eb29817c4e08a27201b73894fb60/users/138249747f8b4ff292e67e93c9a43363/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.485166 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] RBAC: Authorizing `identity:create_grant(project_id=a235eb29817c4e08a27201b73894fb60, user_id=138249747f8b4ff292e67e93c9a43363, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.488109 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.578130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1370/2767] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:23 2022] PUT /identity/v3/projects/a235eb29817c4e08a27201b73894fb60/users/138249747f8b4ff292e67e93c9a43363/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 124 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:23.588849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.589143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.589424 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.616868 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] MFA Rules not processed for user `138249747f8b4ff292e67e93c9a43363`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:23.618105 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:23.682274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1398/2768] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:23 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:23.686936 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.748614 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68956aa-819f-45fe-87ff-31995f741133 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.753469 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.754199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.754491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.754781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.755974 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.757915 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:23.863380 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1371/2769] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:23 2022] POST /identity/v3/projects => generated 383 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:23.867982 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:23.878679 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e2ae96b-9b5f-4c44-8ddd-f96da211611e None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:23.934144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:23.934644 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:23.934925 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:23.935200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:23.935895 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:23.937923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.064350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1399/2770] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:23 2022] POST /identity/v3/users => generated 292 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:24.068337 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.078613 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe6f64d-4e8f-479b-b79f-892f026ac58c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.083135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.084316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.084596 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.084875 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.085605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.087236 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.097621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1372/2771] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:24.102267 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.112402 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-350aaa50-3473-4030-bdfb-09218eeb2524 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.116905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-396dcbc1-477a-4001-bf90-7bdc08675af6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.117551 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcbc1-477a-4001-bf90-7bdc08675af6 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.117828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcbc1-477a-4001-bf90-7bdc08675af6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.118198 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-396dcbc1-477a-4001-bf90-7bdc08675af6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.118920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dcbc1-477a-4001-bf90-7bdc08675af6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.120494 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-396dcbc1-477a-4001-bf90-7bdc08675af6 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.125654 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:24.130937 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1400/2772] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:24.134866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.144933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c49c424b-4d88-45ea-89e6-3404781acf3f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.150229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.151896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.151896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.151896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] PATH_INFO: `/v3/projects/10f52854f52b48c6bfbc2bcb474898f5/users/462cd72f85d84bd887bd6592ee3ad0d4/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.166675 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] RBAC: Authorizing `identity:create_grant(project_id=10f52854f52b48c6bfbc2bcb474898f5, user_id=462cd72f85d84bd887bd6592ee3ad0d4, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.169333 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.263840 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1373/2773] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:24 2022] PUT /identity/v3/projects/10f52854f52b48c6bfbc2bcb474898f5/users/462cd72f85d84bd887bd6592ee3ad0d4/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:24.277880 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.278204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.278487 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.304797 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] MFA Rules not processed for user `462cd72f85d84bd887bd6592ee3ad0d4`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:24.306001 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:24.372717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1401/2774] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:24 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:24.377259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.442910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b8b7ae-17d6-4cda-84fe-fd1d8fbd90aa admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.448605 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.449283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.449568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.449849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.450569 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.452478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.516603 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1374/2775] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:24 2022] POST /identity/v3/projects => generated 385 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:24.518983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.531217 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b178804-129a-4cee-ac56-f8929e25e474 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.587611 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.588276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.588560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.588837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.589528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.591463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.707748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1402/2776] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:24 2022] POST /identity/v3/users => generated 299 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:24.712293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.718951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:24.722933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1014a78e-1c1f-4fb4-8db3-65dfca8a618f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.727896 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.728562 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.728872 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.729151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.729880 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.731539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.742467 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1375/2777] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:24.746829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.757293 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c684b3-9610-4f9e-ac76-335b4ad8857b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.762073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.762958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.763263 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.763552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] PATH_INFO: `/v3/projects/cf25877d88054697bcaee4832ab140c7/users/5c3dd342c79440f6bde137935e33153e/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.778832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf25877d88054697bcaee4832ab140c7, user_id=5c3dd342c79440f6bde137935e33153e, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.781429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.863413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1403/2778] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:24 2022] PUT /identity/v3/projects/cf25877d88054697bcaee4832ab140c7/users/5c3dd342c79440f6bde137935e33153e/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:23:24.867721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.877790 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e69ac4-39e6-4d39-9446-694fbc9d6cf3 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.934198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0eda96-1368-4002-82dd-94f5d2f24873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.934873 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eda96-1368-4002-82dd-94f5d2f24873 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.935158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eda96-1368-4002-82dd-94f5d2f24873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.935468 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0eda96-1368-4002-82dd-94f5d2f24873 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.936198 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eda96-1368-4002-82dd-94f5d2f24873 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.937849 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0eda96-1368-4002-82dd-94f5d2f24873 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.948318 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1376/2779] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:24 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:23:24.952721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:24.962866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-266068eb-891b-444d-bcbb-22cd032d26e3 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:24.967469 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:24.968372 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.968698 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.968976 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] PATH_INFO: `/v3/projects/cf25877d88054697bcaee4832ab140c7/users/5c3dd342c79440f6bde137935e33153e/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:24.971026 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cf25877d88054697bcaee4832ab140c7, user_id=5c3dd342c79440f6bde137935e33153e, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:24.973639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:24.983870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1404/2780] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:24 2022] PUT /identity/v3/projects/cf25877d88054697bcaee4832ab140c7/users/5c3dd342c79440f6bde137935e33153e/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:24.995638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:24.995930 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:24.996241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:25.022721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] MFA Rules not processed for user `5c3dd342c79440f6bde137935e33153e`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:25.023919 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:25.090090 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1377/2781] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:24 2022] POST /identity/v3/auth/tokens => generated 3319 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:25.101764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:25.103491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:25.150571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:25.162429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c6ceb48-bb83-4a15-b728-68b42aea8447 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:25.166075 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:25.166714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:25.166994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:25.167270 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:25.220403 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:25.221832 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:25.232101 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1405/2782] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:25 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 131 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:27.087247 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:27.096691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35553d1e-1656-4ae2-89bf-a6bcc088fac8 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:27.100656 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:27.101285 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:27.101564 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:27.101841 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:27.160377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:27.164541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:27.171214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1378/2783] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:27 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:28.601497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:28.610272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb896-10d3-460c-8d3b-4081f1cb2332 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:28.614205 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c0fde61-4e8c-4f30-b062-e4d4a7ab156c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:28.614845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fde61-4e8c-4f30-b062-e4d4a7ab156c service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:28.615131 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fde61-4e8c-4f30-b062-e4d4a7ab156c service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:28.615438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c0fde61-4e8c-4f30-b062-e4d4a7ab156c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:28.624412 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fde61-4e8c-4f30-b062-e4d4a7ab156c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:28.625822 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c0fde61-4e8c-4f30-b062-e4d4a7ab156c service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:28.635575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1406/2784] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:28 2022] GET /identity/v3/auth/tokens => generated 3319 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:33.232225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:33.243881 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=100 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:33.292631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a974c0-b3ff-462d-8388-a71d9bb9fb9e service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:33.297165 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:33.298111 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:33.298364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:33.298642 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] PATH_INFO: `/v3/users/138249747f8b4ff292e67e93c9a43363` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:33.299819 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] RBAC: Authorizing `identity:delete_user(user_id=138249747f8b4ff292e67e93c9a43363)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:33.301733 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:33.510021 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '138249747f8b4ff292e67e93c9a43363'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:33.517491 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '138249747f8b4ff292e67e93c9a43363'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:33.531585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '138249747f8b4ff292e67e93c9a43363'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:33.532381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '138249747f8b4ff292e67e93c9a43363'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:33.606388 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '138249747f8b4ff292e67e93c9a43363'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:33.613075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1379/2785] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:33 2022] DELETE /identity/v3/users/138249747f8b4ff292e67e93c9a43363 => generated 0 bytes in 383 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:33.617923 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:33.618479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:33.618479 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:33.635467 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:33.636820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:33.696002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1407/2786] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:33.705655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:33.707263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:33.767493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a97cc58-92c7-4a92-ae14-1b3fdbbf58ef admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:33.776301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:33.776301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:33.776301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:33.776301 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:33.785328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:33.786788 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:33.796499 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1380/2787] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:34.190757 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:34.192195 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:34.204931 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f263149-51f1-444e-a22a-75f7cba2dc1f None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:34.209934 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:34.210808 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:34.211111 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:34.211350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] PATH_INFO: `/v3/projects/a235eb29817c4e08a27201b73894fb60` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:34.212556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] RBAC: Authorizing `identity:delete_project(project_id=a235eb29817c4e08a27201b73894fb60)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:34.214496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:34.346503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'a235eb29817c4e08a27201b73894fb60', 'request_id': 'req-4a3e03e9-521d-4903-b088-3b84903ad147'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.351892 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'a235eb29817c4e08a27201b73894fb60', 'request_id': 'req-4a3e03e9-521d-4903-b088-3b84903ad147'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.358106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'a235eb29817c4e08a27201b73894fb60', 'request_id': 'req-4a3e03e9-521d-4903-b088-3b84903ad147'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.427983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] The token cache is being invalidate because project a235eb29817c4e08a27201b73894fb60 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:34.428271 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.428903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.430459 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1408/2788] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:34 2022] DELETE /identity/v3/projects/a235eb29817c4e08a27201b73894fb60 => generated 0 bytes in 240 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:34.434435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:34.444089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b140ba21-5d83-41e2-8d4f-65df47bd59a3 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:34.475513 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:34.499537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:34.502393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:34.502393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:34.502393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] PATH_INFO: `/v3/users/462cd72f85d84bd887bd6592ee3ad0d4` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:34.502393 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] RBAC: Authorizing `identity:delete_user(user_id=462cd72f85d84bd887bd6592ee3ad0d4)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:34.504114 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:34.676749 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '462cd72f85d84bd887bd6592ee3ad0d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.683620 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '462cd72f85d84bd887bd6592ee3ad0d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.695332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '462cd72f85d84bd887bd6592ee3ad0d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.695999 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '462cd72f85d84bd887bd6592ee3ad0d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.789104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '462cd72f85d84bd887bd6592ee3ad0d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:34.798588 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1381/2789] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:34 2022] DELETE /identity/v3/users/462cd72f85d84bd887bd6592ee3ad0d4 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:35.210994 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:35.212519 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:35.228980 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a3e03e9-521d-4903-b088-3b84903ad147 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:35.232902 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:35.287598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:35.288497 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:35.288776 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:35.289077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] PATH_INFO: `/v3/projects/10f52854f52b48c6bfbc2bcb474898f5` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:35.290781 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=10f52854f52b48c6bfbc2bcb474898f5)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:35.292659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:35.395233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '10f52854f52b48c6bfbc2bcb474898f5', 'request_id': 'req-6c3f97bd-5baf-4028-bb5e-7ac268367db0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.401299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '10f52854f52b48c6bfbc2bcb474898f5', 'request_id': 'req-6c3f97bd-5baf-4028-bb5e-7ac268367db0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.408004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '10f52854f52b48c6bfbc2bcb474898f5', 'request_id': 'req-6c3f97bd-5baf-4028-bb5e-7ac268367db0'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.515613 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] The token cache is being invalidate because project 10f52854f52b48c6bfbc2bcb474898f5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:35.516018 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.517004 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.519763 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1409/2790] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:35 2022] DELETE /identity/v3/projects/10f52854f52b48c6bfbc2bcb474898f5 => generated 0 bytes in 309 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:35.526389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:35.528020 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:35.541208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba606a-1506-4b6b-8a23-7e9cd1f4281a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:35.602555 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:35.603444 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:35.603727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:35.604002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] PATH_INFO: `/v3/users/5c3dd342c79440f6bde137935e33153e` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:35.605214 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5c3dd342c79440f6bde137935e33153e)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:35.607217 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:35.796747 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5c3dd342c79440f6bde137935e33153e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.803520 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5c3dd342c79440f6bde137935e33153e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.804631 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:35.815529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5c3dd342c79440f6bde137935e33153e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.816221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5c3dd342c79440f6bde137935e33153e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.891966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5c3dd342c79440f6bde137935e33153e'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:35.898008 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1382/2791] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:35 2022] DELETE /identity/v3/users/5c3dd342c79440f6bde137935e33153e => generated 0 bytes in 373 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:36.101214 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:36.104315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:36.120853 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c3f97bd-5baf-4028-bb5e-7ac268367db0 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:36.176556 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:36.177434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:36.177722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:36.177996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] PATH_INFO: `/v3/users/d68b358dc8944f258f4a6b0a5f2a46ec` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:36.179274 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d68b358dc8944f258f4a6b0a5f2a46ec)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:36.181926 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:36.310678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:36.312378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:36.329035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10839e22-4f9b-49a4-aded-fd1b05326848 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:36.335013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:36.335883 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:36.336164 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:36.336447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] PATH_INFO: `/v3/projects/cf25877d88054697bcaee4832ab140c7` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:36.338276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=cf25877d88054697bcaee4832ab140c7)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:36.340207 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:36.378249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:36.383851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd68b358dc8944f258f4a6b0a5f2a46ec'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.395255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd68b358dc8944f258f4a6b0a5f2a46ec'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.402946 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd68b358dc8944f258f4a6b0a5f2a46ec'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.403691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd68b358dc8944f258f4a6b0a5f2a46ec'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.438548 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cf25877d88054697bcaee4832ab140c7', 'request_id': 'req-959ebcfc-c108-4890-944b-2508f510e853'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.444002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cf25877d88054697bcaee4832ab140c7', 'request_id': 'req-959ebcfc-c108-4890-944b-2508f510e853'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.450267 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cf25877d88054697bcaee4832ab140c7', 'request_id': 'req-959ebcfc-c108-4890-944b-2508f510e853'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.503490 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-52c8ae68-17af-4299-8a7b-b78a9014aca7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd68b358dc8944f258f4a6b0a5f2a46ec'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.510151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1410/2792] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:36 2022] DELETE /identity/v3/users/d68b358dc8944f258f4a6b0a5f2a46ec => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:36.514511 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:36.514801 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:36.515082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:36.532813 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:36.534003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:36.564192 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] The token cache is being invalidate because project cf25877d88054697bcaee4832ab140c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:36.564649 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.565127 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:36.566711 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1383/2793] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:36 2022] DELETE /identity/v3/projects/cf25877d88054697bcaee4832ab140c7 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:23:36.595151 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1411/2794] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Jul 06 17:23:36.605159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:36.606721 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:36.671465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959ebcfc-c108-4890-944b-2508f510e853 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:36.724623 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:36.725291 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:36.725573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:36.725847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:36.737036 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:36.738529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:36.749004 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1384/2795] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:37.178996 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:37.180445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:37.192690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84125e3e-651b-4c1f-95bb-29364797ff4c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:37.197359 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:37.198252 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:37.198542 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:37.198819 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] PATH_INFO: `/v3/projects/c04323b16303498a93705bbe7f80271b` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:37.200097 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c04323b16303498a93705bbe7f80271b)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:37.202073 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:37.338369 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c04323b16303498a93705bbe7f80271b', 'request_id': 'req-02ca96b6-8849-455b-b952-2914bf8f7f3f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.344020 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c04323b16303498a93705bbe7f80271b', 'request_id': 'req-02ca96b6-8849-455b-b952-2914bf8f7f3f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.350426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c04323b16303498a93705bbe7f80271b', 'request_id': 'req-02ca96b6-8849-455b-b952-2914bf8f7f3f'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.417323 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] The token cache is being invalidate because project c04323b16303498a93705bbe7f80271b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:37.417914 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.418312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.419881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1412/2796] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:37 2022] DELETE /identity/v3/projects/c04323b16303498a93705bbe7f80271b => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:37.423843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:37.433428 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39cbd1a4-2ffd-49aa-89c2-aed09b3aa6eb service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:37.444545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:37.488194 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:37.489057 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:37.489350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:37.489626 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] PATH_INFO: `/v3/users/10f6a42212734f8dba4d97fece673ab2` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:37.490909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] RBAC: Authorizing `identity:delete_user(user_id=10f6a42212734f8dba4d97fece673ab2)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:37.493138 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:37.703309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '10f6a42212734f8dba4d97fece673ab2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.710010 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '10f6a42212734f8dba4d97fece673ab2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.722601 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '10f6a42212734f8dba4d97fece673ab2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.723263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '10f6a42212734f8dba4d97fece673ab2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.781031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-8f9b1852-b6d1-4ba0-bf82-5bf9cb716742 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '10f6a42212734f8dba4d97fece673ab2'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:37.787091 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1385/2797] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:37 2022] DELETE /identity/v3/users/10f6a42212734f8dba4d97fece673ab2 => generated 0 bytes in 364 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:38.207429 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:38.208866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:38.221983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ca96b6-8849-455b-b952-2914bf8f7f3f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:38.260530 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=12,keystone:SELECT=86,keystone:INSERT=2 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:38.278445 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:38.279387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.279677 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.279955 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] PATH_INFO: `/v3/projects/7b63552ca69e4f4aa63c3914c17772a7` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.281134 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b63552ca69e4f4aa63c3914c17772a7)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:38.283086 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:38.410739 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b63552ca69e4f4aa63c3914c17772a7', 'request_id': 'req-0156101c-8a1e-46be-ae2b-c65bf165f9b3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:38.416548 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b63552ca69e4f4aa63c3914c17772a7', 'request_id': 'req-0156101c-8a1e-46be-ae2b-c65bf165f9b3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:38.423430 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b63552ca69e4f4aa63c3914c17772a7', 'request_id': 'req-0156101c-8a1e-46be-ae2b-c65bf165f9b3'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:38.479257 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] The token cache is being invalidate because project 7b63552ca69e4f4aa63c3914c17772a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:38.479510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:38.480122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0156101c-8a1e-46be-ae2b-c65bf165f9b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:38.481639 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1413/2798] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:38 2022] DELETE /identity/v3/projects/7b63552ca69e4f4aa63c3914c17772a7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:38.486831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.487160 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.487436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.505527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:38.506746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:38.564902 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1386/2799] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:38.573898 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.574216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.574496 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.593103 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:38.594321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:38.601975 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1414/2800] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:38.606104 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:38.615946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d59df223-a409-4005-8539-fa94bdbb24b7 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:38.621053 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:38.621696 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.622056 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.622372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.623076 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:38.623382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:38.624962 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:38.637032 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1387/2801] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:38.641152 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:38.650592 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb50da7-4d36-4cb4-97c0-4d699100ab70 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:38.655230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:38.655875 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.656160 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.656440 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.657156 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:38.659094 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:38.767852 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1415/2802] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:38 2022] POST /identity/v3/projects => generated 369 bytes in 127 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:38.771832 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:38.782260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b771d91d-ef09-4832-a326-7640518752dc admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:38.801101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:38.841810 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:38.842512 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.842803 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.843085 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.843814 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:38.845847 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:38.931667 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1388/2803] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:38 2022] POST /identity/v3/users => generated 285 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:38.935714 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:38.946081 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa96434d-41f9-4ed8-b49f-b4d3730e5db8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:38.950748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:38.951399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.951683 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.951964 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.952689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:38.954345 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:38.965040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1416/2804] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:38.968846 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:38.979457 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21fa9984-f874-4401-9e25-0e46fc85ede9 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:38.984044 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd73629-ac69-4a9d-88eb-c37884ffb801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:38.984695 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd73629-ac69-4a9d-88eb-c37884ffb801 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:38.984977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd73629-ac69-4a9d-88eb-c37884ffb801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:38.985253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd73629-ac69-4a9d-88eb-c37884ffb801 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:38.986257 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd73629-ac69-4a9d-88eb-c37884ffb801 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:38.987835 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd73629-ac69-4a9d-88eb-c37884ffb801 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:38.997519 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1389/2805] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:38 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:39.001546 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.012662 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f387918f-2437-49a1-ab81-2d9b74eba8cd admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.017646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.018601 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.018840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.019122 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] PATH_INFO: `/v3/projects/fc713154f77e4c89894e5dfd7d95578f/users/b3af98e7550a42e1ace8aa9bc9de7d66/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.034571 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fc713154f77e4c89894e5dfd7d95578f, user_id=b3af98e7550a42e1ace8aa9bc9de7d66, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.037242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.120960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1417/2806] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:39 2022] PUT /identity/v3/projects/fc713154f77e4c89894e5dfd7d95578f/users/b3af98e7550a42e1ace8aa9bc9de7d66/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:39.131141 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.131436 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.131719 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.157235 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] MFA Rules not processed for user `b3af98e7550a42e1ace8aa9bc9de7d66`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:39.158459 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:39.221926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1390/2807] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:39 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:39.226397 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.288159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67cc5ad3-286e-4090-8ec3-487c500098b8 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.293255 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.293903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.294213 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.294491 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.295171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.297060 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.307072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:39.399699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1418/2808] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:39 2022] POST /identity/v3/projects => generated 369 bytes in 174 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:39.403208 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.413781 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b498121-dd77-49a7-82d5-7bc085231fea None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.468968 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.469625 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.469906 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.470209 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.470897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.472811 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.559979 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1391/2809] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:39 2022] POST /identity/v3/users => generated 291 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:39.565393 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.579373 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5d7944-e753-4806-b6a7-5e9ec5f8df0d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.584207 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.584862 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.585143 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.585419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.586180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.587783 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.598159 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1419/2810] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:39.602212 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.613541 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2c12595-8348-48b8-942d-998d65485b91 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.618704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.619624 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.619910 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.620188 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] PATH_INFO: `/v3/projects/152b93bbf4344304a7789436a73041bb/users/59f332649e4342ca8239ca78de5e2937/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.635579 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] RBAC: Authorizing `identity:create_grant(project_id=152b93bbf4344304a7789436a73041bb, user_id=59f332649e4342ca8239ca78de5e2937, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.638316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.641661 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:39.714345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1392/2811] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:39 2022] PUT /identity/v3/projects/152b93bbf4344304a7789436a73041bb/users/59f332649e4342ca8239ca78de5e2937/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:39.718383 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.728746 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8b1716-d34a-4690-bd3b-eaab5d9fff0d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.784622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-612bb43f-7587-4a31-a11b-cd1254a1136a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.785322 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb43f-7587-4a31-a11b-cd1254a1136a admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.785607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb43f-7587-4a31-a11b-cd1254a1136a admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.785888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-612bb43f-7587-4a31-a11b-cd1254a1136a admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.786646 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bb43f-7587-4a31-a11b-cd1254a1136a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.788275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-612bb43f-7587-4a31-a11b-cd1254a1136a admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.798366 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1420/2812] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:39 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:39.802435 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.813545 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-385f842c-e99c-489f-b708-1d0a8358c63c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:39.818578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:39.820670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.820670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.820670 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] PATH_INFO: `/v3/projects/152b93bbf4344304a7789436a73041bb/users/59f332649e4342ca8239ca78de5e2937/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.822135 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] RBAC: Authorizing `identity:create_grant(project_id=152b93bbf4344304a7789436a73041bb, user_id=59f332649e4342ca8239ca78de5e2937, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:39.824897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:39.835831 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1393/2813] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:39 2022] PUT /identity/v3/projects/152b93bbf4344304a7789436a73041bb/users/59f332649e4342ca8239ca78de5e2937/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:39.847243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:39.847637 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:39.847920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:39.879356 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] MFA Rules not processed for user `59f332649e4342ca8239ca78de5e2937`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:39.880583 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:39.953281 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1421/2814] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:39 2022] POST /identity/v3/auth/tokens => generated 3303 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:39.966507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:39.967599 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:40.028838 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b6f648-bec2-4cf8-b0a9-4f7a55baf271 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:40.032461 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:40.033110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:40.033396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:40.033677 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:40.043720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:40.045161 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:40.055068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1394/2815] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:39 2022] GET /identity/v3/auth/tokens => generated 3303 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:40.158534 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:40.160024 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:40.172990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6bd6c0a-4493-47ad-bf48-5170522b6264 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:40.176730 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:40.177398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:40.177682 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:40.178343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:40.237764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:40.239273 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:40.244434 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:40.249106 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1422/2816] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:40 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:43.108539 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:43.109964 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:43.178729 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c13b592-7aa5-42e0-992c-13b5ceade813 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:43.184261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:43.184898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:43.185178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:43.185451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:43.187199 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:43.199095 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:43.200701 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fccf5324-50fd-4b32-820f-f00afdbe5678 service placement] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:43.210447 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1395/2817] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:44.937040 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:45.004671 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7637d9a-5762-4158-8445-211d5bddb910 service cinder] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:45.009300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:45.010212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:45.010495 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:45.010774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] PATH_INFO: `/v3/users/b3af98e7550a42e1ace8aa9bc9de7d66` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:45.011960 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3af98e7550a42e1ace8aa9bc9de7d66)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:45.013874 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:45.246821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3af98e7550a42e1ace8aa9bc9de7d66'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:45.258713 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3af98e7550a42e1ace8aa9bc9de7d66'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:45.265499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3af98e7550a42e1ace8aa9bc9de7d66'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:45.266233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3af98e7550a42e1ace8aa9bc9de7d66'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:45.337622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3af98e7550a42e1ace8aa9bc9de7d66'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:45.344784 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1423/2818] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:44 2022] DELETE /identity/v3/users/b3af98e7550a42e1ace8aa9bc9de7d66 => generated 0 bytes in 408 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:45.349256 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:45.350168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:45.350455 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:45.368511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:45.369757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:45.430995 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1396/2819] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:45.440870 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:45.442543 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:45.500138 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e323727-035a-4d88-8162-c0492f06ff0c admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:45.503805 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:45.504450 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:45.504733 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:45.505008 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:45.514080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:45.515447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:45.524885 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1424/2820] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Jul 06 17:23:45.927276 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:45.928697 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:45.940689 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-474541a1-d2b2-4d29-882a-67ee87c5c248 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:45.945451 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:45.946357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:45.946641 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:45.946921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] PATH_INFO: `/v3/projects/fc713154f77e4c89894e5dfd7d95578f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:45.948655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fc713154f77e4c89894e5dfd7d95578f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:45.957824 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:45.961992 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:46.067799 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fc713154f77e4c89894e5dfd7d95578f', 'request_id': 'req-f1482d68-d07e-41a3-926e-e6ce7450f639'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.073507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fc713154f77e4c89894e5dfd7d95578f', 'request_id': 'req-f1482d68-d07e-41a3-926e-e6ce7450f639'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.079678 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fc713154f77e4c89894e5dfd7d95578f', 'request_id': 'req-f1482d68-d07e-41a3-926e-e6ce7450f639'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.165594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] The token cache is being invalidate because project fc713154f77e4c89894e5dfd7d95578f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:46.165887 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.186516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.186516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1397/2821] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:45 2022] DELETE /identity/v3/projects/fc713154f77e4c89894e5dfd7d95578f => generated 0 bytes in 242 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:46.189272 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:46.199626 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42549c30-1243-4f6b-b720-32c38b56801e service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:46.220900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:46.268829 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:46.269803 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:46.270154 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:46.270438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] PATH_INFO: `/v3/users/59f332649e4342ca8239ca78de5e2937` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:46.271983 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=59f332649e4342ca8239ca78de5e2937)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:46.274245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:46.439930 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '59f332649e4342ca8239ca78de5e2937'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.452580 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '59f332649e4342ca8239ca78de5e2937'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.459335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '59f332649e4342ca8239ca78de5e2937'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.460000 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '59f332649e4342ca8239ca78de5e2937'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.517886 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-adfc0fd5-d244-417a-b352-7f1d4d487e69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '59f332649e4342ca8239ca78de5e2937'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:46.523940 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1425/2822] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:46 2022] DELETE /identity/v3/users/59f332649e4342ca8239ca78de5e2937 => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:46.893241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:46.899884 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:46.914829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1482d68-d07e-41a3-926e-e6ce7450f639 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:46.972238 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:46.973018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:46.973299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:46.973572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] PATH_INFO: `/v3/projects/152b93bbf4344304a7789436a73041bb` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:46.974738 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] RBAC: Authorizing `identity:delete_project(project_id=152b93bbf4344304a7789436a73041bb)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:46.976899 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.081065 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '152b93bbf4344304a7789436a73041bb', 'request_id': 'req-703b263f-c865-4150-95b0-695363a23624'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:47.086632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '152b93bbf4344304a7789436a73041bb', 'request_id': 'req-703b263f-c865-4150-95b0-695363a23624'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:47.092821 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '152b93bbf4344304a7789436a73041bb', 'request_id': 'req-703b263f-c865-4150-95b0-695363a23624'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:47.165622 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] The token cache is being invalidate because project 152b93bbf4344304a7789436a73041bb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:47.165909 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:47.166553 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-703b263f-c865-4150-95b0-695363a23624 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:47.168084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1398/2823] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:46 2022] DELETE /identity/v3/projects/152b93bbf4344304a7789436a73041bb => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:47.172959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.173256 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.173538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.192036 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:47.193222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:47.252175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1426/2824] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:47.259728 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.260018 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.260295 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.277959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:47.279175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:47.286966 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1399/2825] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:47.290945 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.300972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-712cd6b7-3e6c-4dd6-a94d-5e90eaa67acd None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:47.305481 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:47.306153 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.306438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.307299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.308035 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:47.308343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:47.309958 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.321175 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1427/2826] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:47.325308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.334594 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b133411-5bda-48a3-88b4-fd6aec640dd0 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:47.339450 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:47.340092 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.340401 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.340676 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.341356 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:47.343637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.429931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=83,keystone:DELETE=14,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:47.436031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1400/2827] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:47 2022] POST /identity/v3/projects => generated 389 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:47.440066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.450609 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c75c4a5-a640-4727-a9d4-442626032895 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:47.476069 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:47.506212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:47.506836 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.507132 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.507415 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.508112 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:47.510541 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.618144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1428/2828] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:47 2022] POST /identity/v3/users => generated 295 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Jul 06 17:23:47.622822 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.633378 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6005ef62-8150-4777-a58e-307b599f4959 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:47.638537 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:47.639193 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.639500 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.639780 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.640540 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:47.642154 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.652426 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1401/2829] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:47.659057 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.669047 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98182145-4373-41ba-92a5-d2f1a9bf5c31 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:47.673674 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-144c0d1e-eb8c-4073-92b4-e54f67a190a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:47.674573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0d1e-eb8c-4073-92b4-e54f67a190a2 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.674920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0d1e-eb8c-4073-92b4-e54f67a190a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.675437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-144c0d1e-eb8c-4073-92b4-e54f67a190a2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.676545 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c0d1e-eb8c-4073-92b4-e54f67a190a2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:47.678221 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-144c0d1e-eb8c-4073-92b4-e54f67a190a2 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.689321 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1429/2830] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:47 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:47.693221 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.704390 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd538bfc-5f2d-4c21-838a-f8fb1d7bbfc7 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:47.709269 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:47.713746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.713746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.713746 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] PATH_INFO: `/v3/projects/c930686e3df64139b4ef77c4ee444ed6/users/a1dda01998ed474294f18b684ce24b40/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.725866 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c930686e3df64139b4ef77c4ee444ed6, user_id=a1dda01998ed474294f18b684ce24b40, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:47.728587 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:47.830149 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1402/2831] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:47 2022] PUT /identity/v3/projects/c930686e3df64139b4ef77c4ee444ed6/users/a1dda01998ed474294f18b684ce24b40/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 137 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:47.840435 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:47.840722 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:47.841003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:47.866838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] MFA Rules not processed for user `a1dda01998ed474294f18b684ce24b40`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:47.868046 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:47.930312 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1430/2832] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:47 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:47.935382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:47.998306 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-843830d2-c75f-4820-bf10-4919e167e927 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.003054 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.003703 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.004006 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.004283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.004954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.006865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.117015 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1403/2833] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:47 2022] POST /identity/v3/projects => generated 387 bytes in 182 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:48.121721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.133589 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a068159-c619-468e-aae3-0a567fc44617 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.193717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.194510 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.194860 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.195208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.195912 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.197882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.264396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1431/2834] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:48 2022] POST /identity/v3/users => generated 300 bytes in 143 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:48.268616 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.279191 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a65f0fdf-b2c2-473a-8f8b-af02248b3c50 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.283717 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.284409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.284693 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.284967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.285691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.287303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.298142 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1404/2835] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:48.302266 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.313016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac5b5f45-457c-4efd-8120-18b2cf7cd92b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.317593 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.318504 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.318811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.319082 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] PATH_INFO: `/v3/projects/f278712c78b34f8ea4f89cbe98743ade/users/c5d23af3e3984233929fa3bc83745590/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.333310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f278712c78b34f8ea4f89cbe98743ade, user_id=c5d23af3e3984233929fa3bc83745590, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.335974 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.406203 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1432/2836] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:48 2022] PUT /identity/v3/projects/f278712c78b34f8ea4f89cbe98743ade/users/c5d23af3e3984233929fa3bc83745590/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:48.410047 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.420604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bdca34a-294a-4a66-8021-ebc06c977c27 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.475313 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e6e6e79-f2d3-45af-9ef9-ca0922f3a990 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.475970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e6e79-f2d3-45af-9ef9-ca0922f3a990 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.476253 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e6e79-f2d3-45af-9ef9-ca0922f3a990 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.476527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e6e6e79-f2d3-45af-9ef9-ca0922f3a990 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.477241 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e6e79-f2d3-45af-9ef9-ca0922f3a990 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.479657 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e6e6e79-f2d3-45af-9ef9-ca0922f3a990 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.489481 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1405/2837] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:48 2022] GET /identity/v3/roles => generated 1420 bytes in 80 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:48.493652 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.499290 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:48.504595 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e8175-f69a-4778-ad08-456ae0764d3f admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.509306 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.510230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.510514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.510796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] PATH_INFO: `/v3/projects/f278712c78b34f8ea4f89cbe98743ade/users/c5d23af3e3984233929fa3bc83745590/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.512774 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] RBAC: Authorizing `identity:create_grant(project_id=f278712c78b34f8ea4f89cbe98743ade, user_id=c5d23af3e3984233929fa3bc83745590, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.515453 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.526694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1433/2838] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:48 2022] PUT /identity/v3/projects/f278712c78b34f8ea4f89cbe98743ade/users/c5d23af3e3984233929fa3bc83745590/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:48.592343 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.592639 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.592925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.619671 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] MFA Rules not processed for user `c5d23af3e3984233929fa3bc83745590`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:48.620857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:48.644287 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:48.687261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1406/2839] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:48 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:48.698310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.700038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:48.754973 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26d8803a-2944-407b-882d-cfd096b852de admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.758538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-049b07bb-f0a7-4105-9ab6-8e3c0b4b4131 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.759216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b07bb-f0a7-4105-9ab6-8e3c0b4b4131 service cinder] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.759493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b07bb-f0a7-4105-9ab6-8e3c0b4b4131 service cinder] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.759771 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-049b07bb-f0a7-4105-9ab6-8e3c0b4b4131 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.769072 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b07bb-f0a7-4105-9ab6-8e3c0b4b4131 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.770527 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-049b07bb-f0a7-4105-9ab6-8e3c0b4b4131 service cinder] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:48.780354 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1434/2840] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:48 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:48.909529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:48.971159 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b35930f-8ec3-4e11-ba71-25bc7328bb28 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:48.975523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:48.976381 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:48.976664 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:48.976946 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] PATH_INFO: `/v3/users/a1dda01998ed474294f18b684ce24b40` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:48.978156 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] RBAC: Authorizing `identity:delete_user(user_id=a1dda01998ed474294f18b684ce24b40)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:48.980102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:49.143392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a1dda01998ed474294f18b684ce24b40'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:49.150316 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a1dda01998ed474294f18b684ce24b40'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:49.162102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a1dda01998ed474294f18b684ce24b40'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:49.162766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a1dda01998ed474294f18b684ce24b40'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:49.220931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a1dda01998ed474294f18b684ce24b40'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:49.227035 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1407/2841] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:48 2022] DELETE /identity/v3/users/a1dda01998ed474294f18b684ce24b40 => generated 0 bytes in 318 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:49.231463 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:49.231953 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:49.232061 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:49.250518 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:49.251717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:49.310936 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1435/2842] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:49.320472 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:49.321870 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:49.367615 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:49.381933 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d2d4710-fb46-4b51-99ca-f7ce07eda85b admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:49.386308 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:49.386954 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:49.387232 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:49.387505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:49.396397 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:49.397918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:49.407329 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1408/2843] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:49.840144 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:49.841557 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:49.854228 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39023f9e-2b77-4ad0-a498-a0f960476059 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:49.859413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:49.860287 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:49.860823 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:49.861107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] PATH_INFO: `/v3/projects/c930686e3df64139b4ef77c4ee444ed6` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:49.862340 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] RBAC: Authorizing `identity:delete_project(project_id=c930686e3df64139b4ef77c4ee444ed6)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:49.867124 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:50.057831 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c930686e3df64139b4ef77c4ee444ed6', 'request_id': 'req-5e09a047-6cfc-4f8f-97d0-f3510933febc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.063229 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c930686e3df64139b4ef77c4ee444ed6', 'request_id': 'req-5e09a047-6cfc-4f8f-97d0-f3510933febc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.069315 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c930686e3df64139b4ef77c4ee444ed6', 'request_id': 'req-5e09a047-6cfc-4f8f-97d0-f3510933febc'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.142173 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] The token cache is being invalidate because project c930686e3df64139b4ef77c4ee444ed6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:50.142502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.143116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.144650 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1436/2844] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:49 2022] DELETE /identity/v3/projects/c930686e3df64139b4ef77c4ee444ed6 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:50.148655 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:50.158251 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a150df61-1f73-40f1-b379-c51f160b4314 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:50.213153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:50.214013 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:50.214323 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:50.214598 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] PATH_INFO: `/v3/users/c5d23af3e3984233929fa3bc83745590` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:50.215758 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c5d23af3e3984233929fa3bc83745590)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:50.219019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:50.363084 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c5d23af3e3984233929fa3bc83745590'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.370634 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c5d23af3e3984233929fa3bc83745590'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.382573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c5d23af3e3984233929fa3bc83745590'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.383240 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c5d23af3e3984233929fa3bc83745590'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.428659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e32c8b3b-5999-48f4-bd4a-1894e3146067 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c5d23af3e3984233929fa3bc83745590'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:50.435179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1409/2845] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:50 2022] DELETE /identity/v3/users/c5d23af3e3984233929fa3bc83745590 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:50.843071 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:50.844740 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:50.863066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e09a047-6cfc-4f8f-97d0-f3510933febc admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:50.879289 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:50.924905 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:50.925770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:50.926092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:50.926398 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] PATH_INFO: `/v3/projects/f278712c78b34f8ea4f89cbe98743ade` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:50.927676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f278712c78b34f8ea4f89cbe98743ade)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:50.929575 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.045362 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f278712c78b34f8ea4f89cbe98743ade', 'request_id': 'req-0842cdee-fd26-4e6b-9832-b8b99776be82'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:51.050742 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f278712c78b34f8ea4f89cbe98743ade', 'request_id': 'req-0842cdee-fd26-4e6b-9832-b8b99776be82'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:51.056900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f278712c78b34f8ea4f89cbe98743ade', 'request_id': 'req-0842cdee-fd26-4e6b-9832-b8b99776be82'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:51.158990 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] The token cache is being invalidate because project f278712c78b34f8ea4f89cbe98743ade was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80632) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:51.159280 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:51.159968 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0842cdee-fd26-4e6b-9832-b8b99776be82 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:51.161503 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1437/2846] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:50 2022] DELETE /identity/v3/projects/f278712c78b34f8ea4f89cbe98743ade => generated 0 bytes in 319 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:23:51.166970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.167465 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.167581 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.185529 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:51.186989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:51.246466 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1410/2847] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:51.253944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.254269 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.254552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.272526 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:51.273793 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:51.282310 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1438/2848] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:51.286342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.291246 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:51.296662 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f54a014-f538-49c7-8551-5133954c6a81 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.301179 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.302508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.302508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.302508 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.303202 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80631) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:51.303515 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.305136 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.316982 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1411/2849] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:51.321283 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.331245 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-078d7e83-501f-4407-b5ef-d372c5441422 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.335849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.336670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.336948 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.337218 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.337928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.339851 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.418093 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1439/2850] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:51 2022] POST /identity/v3/projects => generated 375 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:51.422177 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.432505 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6507a-aa6c-4411-804b-4fd29c424f8a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.487153 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.487823 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.488110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.488389 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.489089 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.491055 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.578227 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1412/2851] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:51 2022] POST /identity/v3/users => generated 288 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:51.582303 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.592837 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a92e387e-e6ed-42ac-9032-3059819ff5f7 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.597433 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.598116 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.598396 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.598669 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.599431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.600997 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.611276 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1440/2852] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:51.615103 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.625412 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe8610ad-a037-44cb-8fa1-b4dce236019c admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.630119 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a959eb2-a8e6-48e2-a914-8fa4fcc341d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.630778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a959eb2-a8e6-48e2-a914-8fa4fcc341d6 admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.631066 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a959eb2-a8e6-48e2-a914-8fa4fcc341d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.631355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a959eb2-a8e6-48e2-a914-8fa4fcc341d6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.632086 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a959eb2-a8e6-48e2-a914-8fa4fcc341d6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.633685 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a959eb2-a8e6-48e2-a914-8fa4fcc341d6 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.644355 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1413/2853] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:51.648343 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.658259 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ea55b2-4b71-4d79-ad9f-f1fa77df71af admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.662881 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.663745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] REQUEST_METHOD: `PUT` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.664029 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.664309 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] PATH_INFO: `/v3/projects/8d39e43792344afcb3935efbf655343b/users/6b830322a2844b1da959ccc81d964e97/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.678647 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] RBAC: Authorizing `identity:create_grant(project_id=8d39e43792344afcb3935efbf655343b, user_id=6b830322a2844b1da959ccc81d964e97, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.681292 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:51.781183 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1441/2854] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:51 2022] PUT /identity/v3/projects/8d39e43792344afcb3935efbf655343b/users/6b830322a2844b1da959ccc81d964e97/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:51.792069 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.792364 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.792650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.818996 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] MFA Rules not processed for user `6b830322a2844b1da959ccc81d964e97`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:51.820203 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:51.882897 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1414/2855] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:51 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:51.887338 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:51.933536 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:51.950749 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95b4931b-1f11-4793-b12d-33d7b2e80fce admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:51.955516 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:51.956689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:51.956689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:51.956689 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] PATH_INFO: `/v3/projects` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:51.957520 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:51.959451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.060311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1442/2856] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:51 2022] POST /identity/v3/projects => generated 375 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:52.061865 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:52.073415 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a937d0e-97b8-4f4b-b363-8ac2ad013bac None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:52.123712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:52.129619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:52.130332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.130619 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.130900 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] PATH_INFO: `/v3/users` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.131590 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:52.133511 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.217299 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1415/2857] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:52 2022] POST /identity/v3/users => generated 294 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:52.221464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:52.231690 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e928120c-b817-4dba-96b1-a03f45bf487d admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:52.236804 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:52.237405 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.237691 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.237971 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.238735 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:52.240324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.251399 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1443/2858] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:52.255478 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:52.266357 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09a097ad-8fc0-4df6-a5c4-1ca58f96c585 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:52.271031 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:52.271911 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.272366 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.272650 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] PATH_INFO: `/v3/projects/03040f03547a40ceb896f7780d53afdc/users/3c057c5596d04482bd62c343b4cebcdb/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.287487 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] RBAC: Authorizing `identity:create_grant(project_id=03040f03547a40ceb896f7780d53afdc, user_id=3c057c5596d04482bd62c343b4cebcdb, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:52.290176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.375621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1416/2859] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:52 2022] PUT /identity/v3/projects/03040f03547a40ceb896f7780d53afdc/users/3c057c5596d04482bd62c343b4cebcdb/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:52.379820 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:52.390365 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3d080c3-9ba5-4270-8f03-6074de43c449 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:52.444562 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078b292-54ac-4af7-a1a4-28bb4a922bce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:52.445251 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b292-54ac-4af7-a1a4-28bb4a922bce admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.445535 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b292-54ac-4af7-a1a4-28bb4a922bce admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.445815 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078b292-54ac-4af7-a1a4-28bb4a922bce admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.446573 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078b292-54ac-4af7-a1a4-28bb4a922bce admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:52.448828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078b292-54ac-4af7-a1a4-28bb4a922bce admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.458628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1444/2860] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:52 2022] GET /identity/v3/roles => generated 1420 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:52.462493 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:52.472707 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e431ed7-e3c1-46fb-a546-c346a99dd15f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:52.477260 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:52.478174 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.478970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.479250 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] PATH_INFO: `/v3/projects/03040f03547a40ceb896f7780d53afdc/users/3c057c5596d04482bd62c343b4cebcdb/roles/c9170dee3ed14a2982cd1414c2e9984f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.481249 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] RBAC: Authorizing `identity:create_grant(project_id=03040f03547a40ceb896f7780d53afdc, user_id=3c057c5596d04482bd62c343b4cebcdb, role_id=c9170dee3ed14a2982cd1414c2e9984f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:52.483941 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.494750 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1417/2861] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:52 2022] PUT /identity/v3/projects/03040f03547a40ceb896f7780d53afdc/users/3c057c5596d04482bd62c343b4cebcdb/roles/c9170dee3ed14a2982cd1414c2e9984f => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:52.506003 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.506461 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.506744 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.532137 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] MFA Rules not processed for user `3c057c5596d04482bd62c343b4cebcdb`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:52.533350 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:52.600512 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1445/2862] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:52 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:52.612627 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:52.614345 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:52.671152 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f7624fb-2471-45ac-bb1a-9e4de221735d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:52.674691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01bf383d-7886-40e9-8fd5-47653b059efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:52.675325 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf383d-7886-40e9-8fd5-47653b059efb service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:52.675607 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf383d-7886-40e9-8fd5-47653b059efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:52.675882 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01bf383d-7886-40e9-8fd5-47653b059efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:52.729638 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf383d-7886-40e9-8fd5-47653b059efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:52.731101 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01bf383d-7886-40e9-8fd5-47653b059efb service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:52.740158 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1418/2863] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:52 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 128 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:55.751828 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:55.791767 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:55.813092 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8405a360-5873-4809-be12-df8f7a8e9c0b None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:55.817736 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:55.818676 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:55.818959 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:55.819237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] PATH_INFO: `/v3/users/6b830322a2844b1da959ccc81d964e97` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:55.820426 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6b830322a2844b1da959ccc81d964e97)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:55.822419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:55.984748 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6b830322a2844b1da959ccc81d964e97'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:55.996498 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6b830322a2844b1da959ccc81d964e97'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.003395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6b830322a2844b1da959ccc81d964e97'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.004045 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6b830322a2844b1da959ccc81d964e97'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.054879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6b830322a2844b1da959ccc81d964e97'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.061493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1446/2864] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:55 2022] DELETE /identity/v3/users/6b830322a2844b1da959ccc81d964e97 => generated 0 bytes in 310 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:56.065921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:56.066434 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:56.066632 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:56.084282 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:56.085486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:56.143278 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1419/2865] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:56.152849 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:56.154260 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:56.209999 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ad3df3b-2de3-4002-bb7f-1fa0ac806830 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:56.213598 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:56.214258 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:56.214560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:56.214834 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:56.223591 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:56.225015 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:56.234824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1447/2866] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:23:56.659679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:56.661116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:56.669410 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:56.673293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c715c377-c0f5-4776-8358-f60e73060176 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:56.677989 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:56.678890 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:56.679180 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:56.679463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] PATH_INFO: `/v3/projects/8d39e43792344afcb3935efbf655343b` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:56.680712 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8d39e43792344afcb3935efbf655343b)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:56.682672 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:56.793679 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8d39e43792344afcb3935efbf655343b', 'request_id': 'req-c888f046-b774-4fb6-a3b2-6fd396570614'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.798876 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8d39e43792344afcb3935efbf655343b', 'request_id': 'req-c888f046-b774-4fb6-a3b2-6fd396570614'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.806984 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8d39e43792344afcb3935efbf655343b', 'request_id': 'req-c888f046-b774-4fb6-a3b2-6fd396570614'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.871629 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] The token cache is being invalidate because project 8d39e43792344afcb3935efbf655343b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:56.871914 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.872534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:56.874106 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1420/2867] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:56 2022] DELETE /identity/v3/projects/8d39e43792344afcb3935efbf655343b => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:56.878168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:56.888222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a19ead4-c6dd-415e-9481-9bdc37643d2d service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:56.944972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:56.945866 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:56.946186 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:56.946780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] PATH_INFO: `/v3/users/3c057c5596d04482bd62c343b4cebcdb` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:56.947888 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3c057c5596d04482bd62c343b4cebcdb)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:56.949884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:56.951560 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:57.134233 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3c057c5596d04482bd62c343b4cebcdb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.145863 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3c057c5596d04482bd62c343b4cebcdb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.152620 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3c057c5596d04482bd62c343b4cebcdb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.157538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3c057c5596d04482bd62c343b4cebcdb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.228212 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-1b61a7f1-cbe1-4a7e-97ec-227557ae2774 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3c057c5596d04482bd62c343b4cebcdb'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.234830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1448/2868] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:23:56 2022] DELETE /identity/v3/users/3c057c5596d04482bd62c343b4cebcdb => generated 0 bytes in 357 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:57.665038 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:57.666586 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:57.680224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c888f046-b774-4fb6-a3b2-6fd396570614 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:57.736568 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:57.737433 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:57.737718 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:57.738003 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] PATH_INFO: `/v3/projects/03040f03547a40ceb896f7780d53afdc` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:57.739456 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=03040f03547a40ceb896f7780d53afdc)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:57.741112 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:57.852843 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '03040f03547a40ceb896f7780d53afdc', 'request_id': 'req-e8b5eabc-738a-46df-8121-6211403a79c5'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.859041 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '03040f03547a40ceb896f7780d53afdc', 'request_id': 'req-e8b5eabc-738a-46df-8121-6211403a79c5'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.865829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '03040f03547a40ceb896f7780d53afdc', 'request_id': 'req-e8b5eabc-738a-46df-8121-6211403a79c5'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.937549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] The token cache is being invalidate because project 03040f03547a40ceb896f7780d53afdc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:23:57.937776 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.938406 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-e8b5eabc-738a-46df-8121-6211403a79c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:23:57.939931 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1421/2869] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:23:57 2022] DELETE /identity/v3/projects/03040f03547a40ceb896f7780d53afdc => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:57.944766 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:57.946438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:57.946438 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:57.962515 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:57.963708 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:58.021464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1449/2870] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:58.029507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.029796 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.030102 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.048341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:58.049527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:58.057597 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1422/2871] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:58.061694 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.071342 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99192d96-b19c-4ee4-817a-f499f0a0805a None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.075911 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.076555 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.076840 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.077117 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.077838 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:23:58.078180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.079770 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.091538 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1450/2872] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:23:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:23:58.095592 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.104766 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0372ef30-26ed-4528-a95e-fa3951f20d39 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.109945 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.110893 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.111175 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.111454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.112137 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.114051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.122147 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:58.236490 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1423/2873] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:23:58 2022] POST /identity/v3/projects => generated 373 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:58.240326 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.250821 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7134adcd-bac2-43ef-9388-b70b35345634 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.307247 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.307899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.308180 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.308454 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.309136 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.311109 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.320331 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:23:58.420989 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1451/2874] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:23:58 2022] POST /identity/v3/users => generated 287 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:23:58.425270 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.435573 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1b1727c-6dfa-44cb-898f-625897171a48 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.440224 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.440879 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.441162 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.441440 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.442201 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.443921 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.454396 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1424/2875] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:58.458216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.468621 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7664f79c-ad2c-4658-953c-d1f4713e0997 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.473628 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaff187f-0f13-41f8-9b8e-05916847870f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.474318 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff187f-0f13-41f8-9b8e-05916847870f admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.474607 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff187f-0f13-41f8-9b8e-05916847870f admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.474891 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaff187f-0f13-41f8-9b8e-05916847870f admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.475622 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff187f-0f13-41f8-9b8e-05916847870f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.477208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaff187f-0f13-41f8-9b8e-05916847870f admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.487275 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1452/2876] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:23:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:23:58.491130 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.500956 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d16d363-dc32-4327-9be1-a836d130b82f admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.505516 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.506449 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.506734 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.507019 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] PATH_INFO: `/v3/projects/b01fb4c433a044d7bf4fdb537d574d1f/users/26aef5a764d443e1b21bcbeb5ab6022b/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.521647 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b01fb4c433a044d7bf4fdb537d574d1f, user_id=26aef5a764d443e1b21bcbeb5ab6022b, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.524342 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.593068 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1425/2877] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:23:58 2022] PUT /identity/v3/projects/b01fb4c433a044d7bf4fdb537d574d1f/users/26aef5a764d443e1b21bcbeb5ab6022b/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:23:58.598052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d4f5-1afe-4c6e-b652-59658fb879d8 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.598352 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d4f5-1afe-4c6e-b652-59658fb879d8 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.598631 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d008d4f5-1afe-4c6e-b652-59658fb879d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.616387 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-d008d4f5-1afe-4c6e-b652-59658fb879d8 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:23:58.617585 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d008d4f5-1afe-4c6e-b652-59658fb879d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:58.674493 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1453/2878] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:23:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:23:58.683878 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:23:58.685585 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:23:58.741828 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-138c536a-b4f7-4562-8f58-f2f9aca20925 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:23:58.745398 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:23:58.746050 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:23:58.746350 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:23:58.746630 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:23:58.755523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:23:58.756940 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:23:58.766800 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1426/2879] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:23:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:24:00.071699 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355126-051d-4cc5-a778-ccf37a1a81b2 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:00.072249 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355126-051d-4cc5-a778-ccf37a1a81b2 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:00.072427 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d355126-051d-4cc5-a778-ccf37a1a81b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:00.099670 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-0d355126-051d-4cc5-a778-ccf37a1a81b2 None None] MFA Rules not processed for user `26aef5a764d443e1b21bcbeb5ab6022b`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:00.101022 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-0d355126-051d-4cc5-a778-ccf37a1a81b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:00.208725 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1454/2880] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:24:00 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:00.219725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:00.221275 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:00.291048 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf1cb13-ea0f-41ea-851c-64712bcc7092 service neutron] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:00.295303 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:00.295977 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:00.296266 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:00.296550 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:00.305074 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:00.306571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:00.315486 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1427/2881] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:24:00 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:24:01.908800 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:01.909320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:01.909451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:01.926796 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] MFA Rules not processed for user `26aef5a764d443e1b21bcbeb5ab6022b`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:01.927986 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:01.935341 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1455/2882] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:24:01 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:03.227229 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:03.228659 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:03.241110 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-198a560e-a5a2-4ec3-bb9b-cc3cb35971c9 service cinder] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:03.244735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:03.245604 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:03.246077 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:03.246544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:03.248648 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:03.263332 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:03.265200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d6615f7-af1e-4e90-ae16-56b350dc8c05 service neutron] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:03.274503 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1428/2883] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:24:03 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:24:03.350559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:03.360894 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6280f6a-2aaf-488f-83b5-f72f9c5ebb5c None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:03.364636 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:03.366483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:03.366483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:03.366483 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:03.368413 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:03.439395 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=100 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:03.443053 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:03.444514 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2aef67e-2cd5-46f9-81c1-541cffc3c6bb service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:03.456335 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1456/2884] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:24:03 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:24:13.270743 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=77,keystone:INSERT=2 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:13.494938 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=3 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:18.946724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:18.947273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:18.947386 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:18.964635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] MFA Rules not processed for user `26aef5a764d443e1b21bcbeb5ab6022b`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:18.965858 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:18.972700 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1429/2885] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:24:18 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:28.959571 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:37.757447 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767090b-2fe9-4b0a-aed7-5b95f5e8992c None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:37.757956 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767090b-2fe9-4b0a-aed7-5b95f5e8992c None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:37.758096 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a767090b-2fe9-4b0a-aed7-5b95f5e8992c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:37.775261 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-a767090b-2fe9-4b0a-aed7-5b95f5e8992c None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:37.776443 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-a767090b-2fe9-4b0a-aed7-5b95f5e8992c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:37.833222 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1457/2886] 10.222.0.20 () {58 vars in 1009 bytes} [Wed Jul 6 17:24:37 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:37.957372 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:37.958829 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:38.027727 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae734853-fef8-4c08-8b62-89d63147cb77 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:38.032654 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:38.033293 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:38.033578 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:38.033857 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:38.041807 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:38.043420 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:38.051408 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1430/2887] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:24:37 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:24:47.827164 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=25 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:48.048169 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=32 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:54.429038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:54.429038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:54.429038 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:54.445879 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] MFA Rules not processed for user `bf1272ce812546ce8536a7fab6078c14`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:54.447107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:54.455056 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1458/2888] 10.222.0.20 () {58 vars in 967 bytes} [Wed Jul 6 17:24:54 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:54.466735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:54.477184 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb54f51e-2784-437c-ac64-619c7667e3ed service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:54.482178 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0d90c264ccd44a6e88ac202f4e6a4fde', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:54.482815 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:54.483098 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:54.483376 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:54.491523 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:54.493087 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:54.501720 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1431/2889] 10.222.0.20 () {60 vars in 1384 bytes} [Wed Jul 6 17:24:54 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Jul 06 17:24:57.305716 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:57.318076 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fce48ead-207f-4fdf-b413-86dc85e96f25 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:57.322597 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:57.323464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:57.323745 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:57.324023 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] PATH_INFO: `/v3/users/26aef5a764d443e1b21bcbeb5ab6022b` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:57.325209 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] RBAC: Authorizing `identity:delete_user(user_id=26aef5a764d443e1b21bcbeb5ab6022b)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:57.327811 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:57.503230 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '26aef5a764d443e1b21bcbeb5ab6022b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:57.515243 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '26aef5a764d443e1b21bcbeb5ab6022b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:57.521845 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '26aef5a764d443e1b21bcbeb5ab6022b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:57.522596 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '26aef5a764d443e1b21bcbeb5ab6022b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:57.593785 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-0ffef5b0-2a4a-4179-8e5b-1c45910b56ce admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '26aef5a764d443e1b21bcbeb5ab6022b'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:57.600190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1459/2890] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:24:57 2022] DELETE /identity/v3/users/26aef5a764d443e1b21bcbeb5ab6022b => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:24:57.855173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:57.866273 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9cea204-ce18-46a0-9561-d294b82e147c service swift] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:57.923311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:57.924176 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:57.924463 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:57.924761 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] PATH_INFO: `/v3/projects/b01fb4c433a044d7bf4fdb537d574d1f` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:57.925925 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] RBAC: Authorizing `identity:delete_project(project_id=b01fb4c433a044d7bf4fdb537d574d1f)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:57.927898 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.048480 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b01fb4c433a044d7bf4fdb537d574d1f', 'request_id': 'req-4ec7b06f-63e6-4616-af5b-507692ae9345'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:58.054002 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b01fb4c433a044d7bf4fdb537d574d1f', 'request_id': 'req-4ec7b06f-63e6-4616-af5b-507692ae9345'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:58.060172 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b01fb4c433a044d7bf4fdb537d574d1f', 'request_id': 'req-4ec7b06f-63e6-4616-af5b-507692ae9345'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:58.141741 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] The token cache is being invalidate because project b01fb4c433a044d7bf4fdb537d574d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:24:58.141959 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:58.142607 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-4ec7b06f-63e6-4616-af5b-507692ae9345 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:24:58.144139 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1432/2891] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:24:57 2022] DELETE /identity/v3/projects/b01fb4c433a044d7bf4fdb537d574d1f => generated 0 bytes in 290 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Jul 06 17:24:58.149204 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.149492 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.149772 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.168574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:58.169743 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:58.226216 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1460/2892] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:58.234704 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.234998 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.235283 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.254534 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:58.255724 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:58.264189 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1433/2893] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:58.268196 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.277566 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fb7c9-12ba-4c0d-877e-572d0e97c8f1 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.282113 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.282750 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.283028 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.283300 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] PATH_INFO: `/v3/domains` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.284016 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80632) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Jul 06 17:24:58.284317 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.285878 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.297066 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1461/2894] 10.222.0.20 () {58 vars in 1152 bytes} [Wed Jul 6 17:24:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Jul 06 17:24:58.301051 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.310173 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c488051e-e0d2-4577-b1e7-3d11b72dcb03 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.315382 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.316026 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.316335 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.316611 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] PATH_INFO: `/v3/projects` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.317309 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.319225 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.399595 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1434/2895] 10.222.0.20 () {60 vars in 1152 bytes} [Wed Jul 6 17:24:58 2022] POST /identity/v3/projects => generated 385 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:24:58.403965 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.413659 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f6157a2-f448-435f-9f05-867aa47c7c0b admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.460080 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:58.468550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.472002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.472002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.472002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] PATH_INFO: `/v3/users` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.472002 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.472380 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.581558 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1462/2896] 10.222.0.20 () {60 vars in 1143 bytes} [Wed Jul 6 17:24:58 2022] POST /identity/v3/users => generated 293 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Jul 06 17:24:58.585637 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.595867 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e51a5df-3762-4d0f-8b79-b6127d892860 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.600392 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.601046 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.601328 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.601606 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.602377 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.603967 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.615012 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1435/2897] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Jul 06 17:24:58.618876 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.629431 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4bb91d6-3163-483a-a895-165a5dd526a9 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.634011 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-980a1daa-6d93-4380-b086-333bd9120a75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.634721 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1daa-6d93-4380-b086-333bd9120a75 admin admin] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.638041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1daa-6d93-4380-b086-333bd9120a75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.638041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-980a1daa-6d93-4380-b086-333bd9120a75 admin admin] PATH_INFO: `/v3/roles` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.638041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a1daa-6d93-4380-b086-333bd9120a75 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.638041 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-980a1daa-6d93-4380-b086-333bd9120a75 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.647900 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1463/2898] 10.222.0.20 () {58 vars in 1121 bytes} [Wed Jul 6 17:24:58 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Jul 06 17:24:58.652116 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.661970 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12cb267-4b0a-4bba-b9c7-b4c7eba20c3d admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.666549 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.667418 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] REQUEST_METHOD: `PUT` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.667690 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.667960 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] PATH_INFO: `/v3/projects/4827f64d9f9d411ba09b5fa3b4b64cf5/users/f8aabe8968094e78a4fa47e4c0c17783/roles/bdf6277a543a4a4796fbbdb19658a494` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.682691 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] RBAC: Authorizing `identity:create_grant(project_id=4827f64d9f9d411ba09b5fa3b4b64cf5, user_id=f8aabe8968094e78a4fa47e4c0c17783, role_id=bdf6277a543a4a4796fbbdb19658a494)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.685340 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.764125 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1436/2899] 10.222.0.20 () {60 vars in 1482 bytes} [Wed Jul 6 17:24:58 2022] PUT /identity/v3/projects/4827f64d9f9d411ba09b5fa3b4b64cf5/users/f8aabe8968094e78a4fa47e4c0c17783/roles/bdf6277a543a4a4796fbbdb19658a494 => generated 0 bytes in 113 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:24:58.773949 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] REQUEST_METHOD: `POST` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.775564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.775564 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.801294 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.auth.core [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] MFA Rules not processed for user `f8aabe8968094e78a4fa47e4c0c17783`. Rule list: `[]` (Enabled: `True`). {{(pid=80632) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:24:58.802521 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:58.865360 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1464/2900] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:24:58 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:24:58.876453 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:24:58.878168 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:24:58.892384 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:24:58.936694 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6dd3a7d7-e463-440f-9fc9-92a463e6438a admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:24:58.940330 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fbc254-ffb2-404f-b5d9-7d9006d6c593 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'ba635abc81fd47c6b680836c67eeeeea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:24:58.940978 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc254-ffb2-404f-b5d9-7d9006d6c593 service cinder] REQUEST_METHOD: `GET` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:24:58.941263 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc254-ffb2-404f-b5d9-7d9006d6c593 service cinder] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:24:58.941544 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fbc254-ffb2-404f-b5d9-7d9006d6c593 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:24:58.949784 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbc254-ffb2-404f-b5d9-7d9006d6c593 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:24:58.951264 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fbc254-ffb2-404f-b5d9-7d9006d6c593 service cinder] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:24:58.960431 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1437/2901] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:24:58 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:25:02.046384 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:02.107190 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91cf336d-c1e7-466a-bb01-fc12500e99f7 None None] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:02.112464 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:02.113324 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:02.113599 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:02.113873 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] PATH_INFO: `/v3/users/f8aabe8968094e78a4fa47e4c0c17783` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:02.115077 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f8aabe8968094e78a4fa47e4c0c17783)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:02.117017 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:02.295712 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f8aabe8968094e78a4fa47e4c0c17783'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:02.306437 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:25:02.307574 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f8aabe8968094e78a4fa47e4c0c17783'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:02.315126 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f8aabe8968094e78a4fa47e4c0c17783'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:02.315928 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f8aabe8968094e78a4fa47e4c0c17783'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:02.375502 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f8aabe8968094e78a4fa47e4c0c17783'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:02.381522 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1465/2902] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:25:02 2022] DELETE /identity/v3/users/f8aabe8968094e78a4fa47e4c0c17783 => generated 0 bytes in 336 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:25:02.386297 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] REQUEST_METHOD: `POST` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:02.390833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:02.390833 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:02.404206 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.auth.core [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] MFA Rules not processed for user `861320b46d7645f3b4d8d49005174ddc`. Rule list: `[]` (Enabled: `True`). {{(pid=80631) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Jul 06 17:25:02.405391 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:02.462454 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1438/2903] 10.222.0.20 () {58 vars in 957 bytes} [Wed Jul 6 17:25:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Jul 06 17:25:02.472456 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:02.473857 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:02.530237 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba712d20-6ddf-46ad-bcb9-df3769a40c69 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:02.533884 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6f78d8aba8a94343b33000d45c22fae8', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:02.534550 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:02.534833 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:02.535107 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:02.544265 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:02.546394 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:02.555830 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1466/2904] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:25:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:25:02.952809 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:02.954324 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:02.971955 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91b8b846-e8da-4bc7-8020-8b6a01a11cd1 None None] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:02.979268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:02.979268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:02.979268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:02.979268 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] PATH_INFO: `/v3/projects/4827f64d9f9d411ba09b5fa3b4b64cf5` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:02.980764 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] RBAC: Authorizing `identity:delete_project(project_id=4827f64d9f9d411ba09b5fa3b4b64cf5)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:02.982791 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:03.116423 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4827f64d9f9d411ba09b5fa3b4b64cf5', 'request_id': 'req-d68e3efa-db73-4ce4-977c-416b4b5a8c58'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:03.121826 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4827f64d9f9d411ba09b5fa3b4b64cf5', 'request_id': 'req-d68e3efa-db73-4ce4-977c-416b4b5a8c58'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:03.128200 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4827f64d9f9d411ba09b5fa3b4b64cf5', 'request_id': 'req-d68e3efa-db73-4ce4-977c-416b4b5a8c58'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:03.220261 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] The token cache is being invalidate because project 4827f64d9f9d411ba09b5fa3b4b64cf5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:25:03.220554 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:03.221170 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:03.222725 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1439/2905] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:25:02 2022] DELETE /identity/v3/projects/4827f64d9f9d411ba09b5fa3b4b64cf5 => generated 0 bytes in 271 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:25:12.552903 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=33,keystone:INSERT=1,keystone:DELETE=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:25:13.217220 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=74,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:25:40.644792 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:40.646299 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:40.670920 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6cffbc-7c8c-4d41-a18e-73ccea914c3f service neutron] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:40.723320 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:40.724200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:40.724485 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:40.724764 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] PATH_INFO: `/v3/users/859a278562b24044910f65508d7c30aa` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:40.726565 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] RBAC: Authorizing `identity:delete_user(user_id=859a278562b24044910f65508d7c30aa)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:40.728499 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:40.896348 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '859a278562b24044910f65508d7c30aa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:40.908528 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '859a278562b24044910f65508d7c30aa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:40.915882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '859a278562b24044910f65508d7c30aa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:40.916552 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '859a278562b24044910f65508d7c30aa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:40.972717 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '859a278562b24044910f65508d7c30aa'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:40.978780 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1467/2906] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:25:40 2022] DELETE /identity/v3/users/859a278562b24044910f65508d7c30aa => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:25:41.239501 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:41.241546 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:41.255507 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d68e3efa-db73-4ce4-977c-416b4b5a8c58 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:41.313075 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:41.313926 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:41.314259 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:41.314521 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] PATH_INFO: `/v3/projects/1befb3820db34c1f8271b48b767401ae` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:41.315680 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1befb3820db34c1f8271b48b767401ae)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:41.317572 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:41.443409 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1befb3820db34c1f8271b48b767401ae', 'request_id': 'req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.448778 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1befb3820db34c1f8271b48b767401ae', 'request_id': 'req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.454762 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1befb3820db34c1f8271b48b767401ae', 'request_id': 'req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.534117 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] The token cache is being invalidate because project 1befb3820db34c1f8271b48b767401ae was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:25:41.534341 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.535007 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.536757 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1440/2907] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:25:41 2022] DELETE /identity/v3/projects/1befb3820db34c1f8271b48b767401ae => generated 0 bytes in 298 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:25:41.540972 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:41.542419 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:41.555899 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353a08da-e5db-4ca7-a006-0f1f7b8b11be admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:41.610386 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:41.611242 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:41.611525 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:41.611798 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] PATH_INFO: `/v3/users/0cdcf5b8d45e45a9bd027a48efe992f2` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:41.612993 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] RBAC: Authorizing `identity:delete_user(user_id=0cdcf5b8d45e45a9bd027a48efe992f2)` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:41.614944 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:41.636123 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:25:41.808087 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '0cdcf5b8d45e45a9bd027a48efe992f2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.819451 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '0cdcf5b8d45e45a9bd027a48efe992f2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.826168 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '0cdcf5b8d45e45a9bd027a48efe992f2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.828052 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '0cdcf5b8d45e45a9bd027a48efe992f2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.892425 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.notifications [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '0cdcf5b8d45e45a9bd027a48efe992f2'} {{(pid=80632) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:41.899171 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1468/2908] 10.222.0.20 () {58 vars in 1223 bytes} [Wed Jul 6 17:25:41 2022] DELETE /identity/v3/users/0cdcf5b8d45e45a9bd027a48efe992f2 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:25:42.136786 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Authenticating user token {{(pid=80631) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:25:42.138272 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.fernet_utils [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80631) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:25:42.151635 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e9a5ae4-652e-4ce5-8eeb-4d9e0516d3d4 admin admin] Validating token access rules against request {{(pid=80631) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:25:42.207151 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '861320b46d7645f3b4d8d49005174ddc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'e4521befd6aa4cfbb3b9af1101181f7f', 'project_domain_id': 'default', 'roles': ['admin', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80631) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:25:42.208023 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:25:42.208311 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:25:42.208621 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] PATH_INFO: `/v3/projects/e1c448c1d1d74749a0de49ee7e7c0b0a` {{(pid=80631) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:25:42.210477 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e1c448c1d1d74749a0de49ee7e7c0b0a)` {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:25:42.212403 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] RBAC: Authorization granted {{(pid=80631) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:25:42.282735 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:25:42.294470 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e1c448c1d1d74749a0de49ee7e7c0b0a', 'request_id': 'req-58102670-1da1-4d47-89db-f35acc882f13'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:42.299918 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e1c448c1d1d74749a0de49ee7e7c0b0a', 'request_id': 'req-58102670-1da1-4d47-89db-f35acc882f13'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:42.306097 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e1c448c1d1d74749a0de49ee7e7c0b0a', 'request_id': 'req-58102670-1da1-4d47-89db-f35acc882f13'} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:42.419527 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] The token cache is being invalidate because project e1c448c1d1d74749a0de49ee7e7c0b0a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80631) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Jul 06 17:25:42.419754 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:42.420375 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG keystone.notifications [None req-58102670-1da1-4d47-89db-f35acc882f13 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80631) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Jul 06 17:25:42.421951 dv-cinder-806605-6-smb devstack@keystone.service[80631]: [pid: 80631|app: 0|req: 1441/2909] 10.222.0.20 () {58 vars in 1232 bytes} [Wed Jul 6 17:25:42 2022] DELETE /identity/v3/projects/e1c448c1d1d74749a0de49ee7e7c0b0a => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Jul 06 17:25:51.894824 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:DELETE=7,keystone:SELECT=20,keystone:INSERT=1 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:25:52.478082 dv-cinder-806605-6-smb devstack@keystone.service[80631]: DEBUG dbcounter [-] [80631] Writing DB stats keystone:SELECT=12,keystone:DELETE=5,keystone:INSERT=1 {{(pid=80631) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jul 06 17:28:48.073208 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Authenticating user token {{(pid=80632) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Jul 06 17:28:48.074656 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:28:48.215615 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc27d1-c084-4ac5-8c0f-416092e1e6b4 admin admin] Validating token access rules against request {{(pid=80632) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Jul 06 17:28:48.274663 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6aac6f87525e413c8c99e1c6edddf591', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'aff4b31f45664f0694a878308e3e9114', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80632) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Jul 06 17:28:48.275311 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] REQUEST_METHOD: `GET` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Jul 06 17:28:48.275600 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] SCRIPT_NAME: `/identity` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Jul 06 17:28:48.275882 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.server.flask.request_processing.req_logging [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80632) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Jul 06 17:28:48.277706 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.fernet_utils [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80632) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Jul 06 17:28:48.289559 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Jul 06 17:28:48.291200 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-932300ad-f765-4da1-a88a-d3df31156925 service placement] RBAC: Authorization granted {{(pid=80632) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Jul 06 17:28:48.301085 dv-cinder-806605-6-smb devstack@keystone.service[80632]: [pid: 80632|app: 0|req: 1469/2910] 10.222.0.20 () {60 vars in 1365 bytes} [Wed Jul 6 17:28:48 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 228 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Jul 06 17:28:58.296762 dv-cinder-806605-6-smb devstack@keystone.service[80632]: DEBUG dbcounter [-] [80632] Writing DB stats keystone:SELECT=89 {{(pid=80632) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}